-- Logs begin at Tue 2022-05-10 14:15:45 UTC, end at Tue 2022-05-10 15:25:15 UTC. -- May 10 14:53:54.909593 dv-cinder-839628-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 14:53:54.917171 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 14:53:54 2022] *** May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: nodename: dv-cinder-839628-2-iscsi May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: machine: x86_64 May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: clock source: unix May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: pcre jit disabled May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: detected number of CPU cores: 4 May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: current working directory: / May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: detected binary path: /usr/bin/uwsgi-core May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: your processes number limit is 47680 May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: your memory page size is 4096 bytes May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: detected max file descriptor number: 2048 May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: lock engine: pthread robust mutexes May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: thunder lock: enabled May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 14:53:54.923027 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 14:53:54.965261 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: Python main interpreter initialized at 0x55c6492959c0 May 10 14:53:54.965261 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: python threads support enabled May 10 14:53:54.965261 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: your server socket listen backlog is limited to 100 connections May 10 14:53:54.965261 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: your mercy for graceful operations on workers is 90 seconds May 10 14:53:54.965588 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: mapped 403077 bytes (393 KB) for 2 cores May 10 14:53:54.965667 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: *** Operational MODE: preforking *** May 10 14:53:54.965923 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: *** uWSGI is running in multiple interpreter mode *** May 10 14:53:54.965923 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: spawned uWSGI master process (pid: 102609) May 10 14:53:54.966117 dv-cinder-839628-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 14:53:54.967205 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: spawned uWSGI worker 1 (pid: 102610, cores: 1) May 10 14:53:54.967205 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: spawned uWSGI worker 2 (pid: 102611, cores: 1) May 10 14:53:54.967205 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 14:53:56.162467 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:53:56.163082 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:53:56.897470 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:53:56.897470 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: from cryptography.utils import int_from_bytes May 10 14:53:56.897785 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:53:56.897785 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: from cryptography.utils import int_from_bytes May 10 14:53:56.899819 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:53:56.899819 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: from cryptography.utils import int_from_bytes May 10 14:53:56.900216 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:53:56.900216 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: from cryptography.utils import int_from_bytes May 10 14:53:59.482489 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:53:59.483064 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:53:59.483255 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:53:59.483355 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:53:59.483725 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:53:59.483812 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:53:59.483896 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:53:59.484103 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:53:59.484236 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.484470 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:53:59.484570 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.484753 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:53:59.484878 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.485125 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.485224 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.485458 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.486048 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.486313 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.486490 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.486667 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.486767 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487005 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487101 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487325 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487419 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487590 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487690 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487909 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.487997 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.488236 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839628-2-iscsi {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.488324 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.488533 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.488627 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.488858 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.488967 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.489167 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.489248 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839628-2-iscsi {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.489490 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.489593 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.489798 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.489895 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.490119 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.490225 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.490437 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.490528 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.490772 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.491190 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.491353 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.491651 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.491787 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.491977 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.492161 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.492265 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.492478 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.492582 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.492791 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.492893 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.493106 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.493205 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.493446 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.493533 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.493766 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.493859 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.494079 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.494171 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.494415 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.494504 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.494729 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.494812 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839628-2-iscsi {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.495058 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.495145 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.495374 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.495476 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.495718 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.495829 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839628-2-iscsi {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.496079 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.496164 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.496399 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.496489 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.496716 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.496823 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.497035 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.497131 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.497362 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.497450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.497673 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.497768 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.498000 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.498094 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.498320 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.498428 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.498666 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.498761 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.498988 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.499084 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.499295 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.499421 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.499603 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.499695 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.499914 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.500047 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.500221 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.500323 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.500531 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.500627 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.500837 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.501016 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.501099 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.501244 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.502027 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.502122 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.502340 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.502453 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.502621 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.502720 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.502936 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.503029 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.503239 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.503326 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.503495 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.503594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.503816 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.503917 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.504124 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.504209 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.504380 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.504465 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.504704 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.504800 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.505023 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.505107 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.505332 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.505417 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.505641 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.505735 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.505950 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.506040 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.506253 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.506346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.506587 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.506674 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.506899 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.506985 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.507213 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.507308 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.507532 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.507625 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.507857 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.507943 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.508179 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.508270 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.508507 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.508594 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.508814 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.508897 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.509125 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.509218 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.509468 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.509573 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.509767 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.509853 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.510082 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.510177 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.510425 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.510514 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.510744 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.510831 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.511057 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.511153 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.511369 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.511460 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.511679 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.511764 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.511992 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.512085 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.512305 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.512391 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.512610 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.512694 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.512863 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.512951 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.513169 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.513261 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.513478 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.513565 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.513774 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.513859 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.514081 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.514167 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.514400 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.514488 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.514726 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.514814 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.515028 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.515119 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.515336 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.515421 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.515641 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.515727 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.515942 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.516030 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.516247 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.516332 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.516553 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.516637 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.518688 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.518807 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.518807 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519035 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519118 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519237 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519323 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519413 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519509 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519598 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519680 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519757 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519841 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.519924 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520008 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520092 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520092 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520353 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520481 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520576 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520656 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520743 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520834 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.520921 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521014 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521101 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521180 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521266 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521345 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521432 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521512 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521596 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521707 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.521802 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.522017 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.522103 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.522328 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.522432 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.522679 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.522779 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.522978 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.523071 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.523288 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.523374 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.523608 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.523706 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.523914 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.523998 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.524223 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.524306 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.524524 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.524617 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.524831 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.524917 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.525138 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.525224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.525442 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.525527 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.525743 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.525827 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.526049 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.526133 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.526346 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.526489 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.526682 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.526767 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.526994 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.527079 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.527301 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.527395 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.527604 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.527689 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.527913 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.528075 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.528233 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.528319 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.528540 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.528624 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.528850 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.528945 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.529175 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:53:59.529277 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.529517 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.529610 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.529845 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.529940 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.530178 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.530280 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.530521 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.530616 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.530832 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.530918 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.531148 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.531234 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.531477 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.531571 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.531792 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.531877 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.532103 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.532187 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.532436 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.532520 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.532759 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.532851 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.533075 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.533159 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.533390 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.533482 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.533710 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.533803 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.534028 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.534114 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.534346 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.534462 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.534692 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.534784 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.535007 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.535094 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.535327 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.535411 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.535646 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.535731 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.535957 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.536043 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.536286 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.536378 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.536616 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.536703 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.536930 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.537015 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.537262 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.537357 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.537584 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.537679 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.537896 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.538007 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.538211 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.538321 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.538549 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.538651 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.538876 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.538970 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.539191 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.539288 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.539510 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.539647 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.539822 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.539959 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.540135 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.540282 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.540449 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.540660 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.540828 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.540957 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.541100 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.541233 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.541372 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.541507 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.541677 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.541806 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.541991 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.542134 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.542304 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.542464 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.542644 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.542733 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.542964 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.543051 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.543279 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.543363 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.543590 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.543677 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.543904 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.543991 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.544212 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.544297 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.544520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.544616 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.544827 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.544955 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.545134 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.545218 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.545438 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.545535 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.545745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.545836 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.546061 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.546152 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.546366 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.546482 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.546716 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.546801 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.547021 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.547106 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.547342 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.547435 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.547655 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.547740 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.547967 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.548535 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.548791 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.548886 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.549105 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.549189 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.549414 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.549539 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.549721 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.549807 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.550040 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.550125 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.550351 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.550464 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.550695 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.550815 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.551010 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.551110 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.551319 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.551407 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.551626 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.551715 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.551943 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.552031 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.552250 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.552352 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.552560 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.552646 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.552874 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.552959 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.553185 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.553277 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.553502 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.553588 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.553813 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.553897 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.554126 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.554219 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.554481 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.554570 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.554802 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.554886 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.555112 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.555210 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.555439 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.555525 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.555767 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.555852 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.556074 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.556160 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.556376 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.556459 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.556688 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.556780 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.556995 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.557082 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.557306 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.557393 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.557611 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.557701 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.557918 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.558003 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.558219 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.558304 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.558551 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.558640 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.558859 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.558954 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.559162 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.559246 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.559467 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.559612 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.559773 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.559901 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.560083 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.560217 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.560383 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.560522 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.560671 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.560824 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.560978 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.561072 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.561296 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.561402 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.561604 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.561690 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.561914 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.562006 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.562259 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.562367 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.562591 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.562676 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.562914 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.562998 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.563230 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.563318 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.563548 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.563634 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.564397 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.564493 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.564710 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.564796 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.565022 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.565107 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.565336 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.565424 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.565656 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.565743 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.565966 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.566051 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.566278 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.566362 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.566615 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.566702 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.566932 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.567022 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.567243 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.567337 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.567562 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.567647 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.567864 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.567948 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.568180 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.568274 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.568499 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.568590 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.568811 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.568896 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.569132 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.569225 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.569451 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.569547 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.569763 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.569849 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.570079 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.570178 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.570409 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.570498 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.570722 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.570807 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.571034 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.571186 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.571328 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.571466 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.571641 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.571772 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.571948 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.572078 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.572260 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.572387 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.572565 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.572700 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.572888 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.573019 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.573198 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.573338 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.573509 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.573644 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.573809 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.573939 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.574123 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.574253 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.574466 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.574606 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.574778 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.574908 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.575092 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.575225 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.575404 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.575535 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.575724 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.575860 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.576035 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.576164 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.576346 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.576483 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.576657 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.576791 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.576962 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.577091 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.577273 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.577413 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.577579 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.577707 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.577889 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.578020 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.578194 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.578339 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.578529 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.578658 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.578833 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.578962 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.579148 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.579316 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.579489 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.579652 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.579794 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.579929 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.580124 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.580253 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.580388 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.580530 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.580698 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.580826 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.581037 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.581169 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.581310 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.581441 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.581619 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.581852 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.581990 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.582164 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.582301 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.582494 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.582636 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.582815 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.582954 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.583127 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.583291 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.583462 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.583595 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.583742 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.583875 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.584006 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.584144 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.584333 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.584463 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.584644 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.584786 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.584935 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.585026 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.585249 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.585336 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.585570 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.585657 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.585879 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.585966 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.586192 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.586276 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.586528 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.586636 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.586840 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.586934 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.587153 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.587246 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.587472 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.587556 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.587781 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.587880 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.588093 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.588187 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.588403 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.588488 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.588716 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.588799 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.589020 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.589113 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.589334 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.589425 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.589642 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.589772 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.589952 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.590048 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.590263 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.590347 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.590589 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.590687 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.590900 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.590991 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.591206 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.591301 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.591523 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.591773 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.591869 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.592112 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.592403 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.592490 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.592741 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.592825 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.593064 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.593149 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.593380 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.593463 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.593706 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.593791 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.594033 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.594118 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.594362 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.594506 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.594697 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.594793 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.595037 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.595137 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.595344 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.595439 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.595652 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.595745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.595968 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.596061 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.596277 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.596362 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.596583 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.596666 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.596890 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.596977 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.597198 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.597283 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.597502 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.597585 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.597808 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.597903 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.598114 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.598198 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.598436 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.598526 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.598749 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.598845 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.599050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.599136 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.599365 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.599449 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.599667 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.599761 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.599981 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.600118 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.600289 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.600375 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.600595 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.600693 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.600901 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.600987 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.601207 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.601291 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.601518 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.601605 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.601828 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.601920 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.602159 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.602244 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.602517 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.602630 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.603731 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.603907 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.603907 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.604239 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.604406 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.604554 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.604674 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.604674 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.604977 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.605156 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.605583 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.605667 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.605766 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.606015 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.606191 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.606482 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.606674 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.606788 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.606872 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.606969 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.607154 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.607282 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.607554 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.607669 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.608135 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.608766 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.608882 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.609087 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.609185 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.609407 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.609503 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.609724 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.609842 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.610036 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.610157 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.610352 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.610481 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.611206 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.611329 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.611523 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.611642 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.611823 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.612042 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.612204 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.612350 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.612491 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.612631 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.612776 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.612917 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.613055 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.613200 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.613342 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.613484 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.613621 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.613765 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.613906 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.614058 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.614197 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.614335 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.614520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.614617 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.614831 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.614919 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.615142 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.615233 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.615450 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.615541 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.615763 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.616106 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.616323 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.616408 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.616635 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.616721 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.616943 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.617037 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.617248 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.617333 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.617551 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.617642 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.617862 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.617956 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.618167 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.618254 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.618496 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.618600 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.618811 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.618908 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.619125 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.619220 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.619437 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.619533 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.619737 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.619832 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.620044 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.620150 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.620345 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.620448 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.620650 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.620750 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.620950 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.621036 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.621253 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.621350 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.621555 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.621640 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.621859 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.621994 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.622160 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.622246 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.622487 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.622593 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.622792 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.622884 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.623096 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.623188 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.623404 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.623491 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.623705 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.623792 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.624011 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.624105 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.624315 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.624409 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.624656 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.624748 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.624961 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.625049 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.625298 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.625384 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.625606 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.625705 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.625918 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.626008 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.626278 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.626902 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.627121 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.627220 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.627439 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.627525 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.627753 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.627847 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.628054 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.628150 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.628370 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.628454 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.628679 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.628770 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.628996 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.629094 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.629304 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.629392 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.629610 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.629706 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.629930 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.630024 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.630239 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.630327 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.630579 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.630669 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.630897 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.630989 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.631215 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.631303 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.631532 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.631624 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.631833 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.631923 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.632146 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.632287 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.632454 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.632589 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.632748 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.632888 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.633054 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.633185 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.633365 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.633495 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.633676 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.633806 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.633984 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.634119 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.634292 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.634476 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.634631 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.634787 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.634947 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.635078 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.635256 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.635398 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.635580 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.635709 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.635892 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.636020 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.636194 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.636331 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.636503 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.636811 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.636942 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.637146 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.637281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.637410 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.637538 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.637703 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.637839 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.638013 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.638150 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.638318 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.638503 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.638774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.638904 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.639085 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.639224 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.639396 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.639529 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.639704 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.639838 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.640017 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.640159 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.640323 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.640425 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.640635 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.640730 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.640950 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.641038 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.641256 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.641344 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.641644 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.641740 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.641980 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.642070 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.642290 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.642406 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.642625 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.642723 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.642933 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.643026 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.643236 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.643323 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.643542 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.643639 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.643853 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.643939 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.644155 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.644241 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.644461 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.644559 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.644765 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.644857 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.645084 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.645177 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.645398 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.645519 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.645720 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.645831 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.646136 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.646230 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.646474 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.646566 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.646783 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.646878 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.647125 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.647217 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.647450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.647546 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.647776 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.647869 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.648090 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.648188 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.648410 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.648506 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.648725 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.648825 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.649027 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.649114 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.649341 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.649427 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.649651 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.649738 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.649967 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.650063 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.650280 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.650378 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.650616 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.650709 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.650933 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.651027 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.651237 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.651334 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.651559 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.651651 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.651876 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.651962 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.652191 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.652324 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.652529 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.652617 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.652909 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.652994 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.653242 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.653330 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.653554 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.653640 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.653860 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.653946 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.654175 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.654262 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.654505 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.654631 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.654814 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.654902 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.655127 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.655214 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.655433 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.655527 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.655735 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.655822 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.656050 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.656143 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.656352 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.656438 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.656660 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.656808 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.656975 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.657072 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.657283 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.657370 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.657617 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.657716 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.657922 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.658008 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.658255 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.658340 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.658598 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.658696 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.658923 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.659018 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.659231 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.659316 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.659550 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.659643 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.659864 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.659957 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.660166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.660252 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.660471 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.660565 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.660781 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.660874 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.661083 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.661169 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.661388 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.661482 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.661694 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.661787 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.662036 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.662122 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.662353 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.662493 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.662688 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.662786 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.663021 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.663109 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.663352 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.663438 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.663663 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.663748 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.663983 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.664076 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.664312 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.664404 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.664621 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.664753 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.664932 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.665033 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.665250 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.665338 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.665562 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.665648 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.665874 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.665968 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.666183 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.666276 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.666522 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.666612 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.666828 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.666927 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.667133 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.667218 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.667444 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.667539 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.667748 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.667834 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.668055 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.668142 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.668363 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.668457 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.668686 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.668772 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.668988 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.669079 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.669294 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.669381 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.669603 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.669696 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.669908 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.669992 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.670217 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.670304 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.670551 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.670640 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.670895 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.670981 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.671204 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.671300 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.671533 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.671619 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.671849 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.671943 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.672171 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.672268 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.672487 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.672615 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.672798 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.672891 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.673638 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.673746 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.673955 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.674047 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.674269 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.674354 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.674617 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.674725 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.674937 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.675034 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.675252 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.675339 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.675571 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.675667 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.675888 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.675975 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.676210 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.676296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.676548 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.676744 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.676865 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.677083 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.677190 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.677407 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.677727 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.677831 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.678045 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.678130 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.678361 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.678474 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.678704 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.678791 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.679014 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.679106 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.679330 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.679423 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.679641 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.679727 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.679956 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.680052 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.680267 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.680371 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.680580 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.680673 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.680894 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.680981 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.681222 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.681318 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.681545 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.681638 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.681861 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.681946 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.682183 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.682270 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.682526 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.682615 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.682914 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.683029 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.683231 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.683321 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.683547 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.683638 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.683864 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.683966 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.684187 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.684283 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.684504 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.684589 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.684817 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.685015 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.685130 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.685216 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.685446 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.685539 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.685754 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.685849 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.686068 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.686161 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.686378 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.686519 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.686714 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.686809 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.687027 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.687122 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.687344 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.687432 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.687658 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.687752 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.687972 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.688068 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.688298 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.688394 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.688612 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.688745 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.689472 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.689568 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.689790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.689997 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.690105 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.690322 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.690450 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.690686 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.690970 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.691112 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.691289 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.691378 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.691621 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.691708 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.691944 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.692039 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.692266 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.692397 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.692574 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.692661 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.692885 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.692974 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.693200 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.693294 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.693503 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.693589 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.693807 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.693893 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.694115 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.694206 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.694448 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.694541 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.694756 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.694844 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.695077 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.695170 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.695387 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.695483 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.695693 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.695919 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.696013 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.696270 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.696356 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.696592 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.696824 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.696910 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.697176 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.697271 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.697495 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.697590 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.697821 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.697915 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.698145 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.698233 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.698473 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.698573 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.698790 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.698878 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.699111 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.699198 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.699420 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.699516 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.699725 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.699812 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.700035 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.700130 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.700344 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.700431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.700649 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.700735 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.700953 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.701038 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.701262 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.701359 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.701567 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.701663 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.701867 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.701953 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.702179 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.702267 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.702507 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.702600 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.702815 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.702951 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.703127 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.703221 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.703432 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.703527 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.703735 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.703828 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.704043 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.704130 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.704369 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.704464 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.704672 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.704773 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.704979 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.705071 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.705282 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.705384 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.705586 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.705688 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.705885 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.705981 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.706193 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.706279 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.706518 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.706623 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.706832 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.706925 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.707139 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.707233 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.707451 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.707540 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.707777 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.707862 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.708098 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.708185 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.708402 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.708489 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.708707 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.708795 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.709021 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.709108 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.709330 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.709423 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.709650 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.709737 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.709964 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.710050 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.710276 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.710539 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.710642 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.710879 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.710967 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.711206 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.711466 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.711553 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.711804 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.711897 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.712128 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.712226 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.712460 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.712591 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.712775 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.712862 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.713083 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.713185 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.713390 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.713478 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.713698 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.713793 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.714011 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.714105 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.714324 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.714437 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.714664 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.714750 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.714974 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.715068 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.715287 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.715384 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.715592 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.715678 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.715906 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.716000 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.716218 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.716304 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.716527 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.716613 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.716838 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.716924 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.717149 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.717241 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.717462 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.717558 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.717773 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.717860 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.718089 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.718175 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.718432 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.718533 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.718758 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.718846 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.719074 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.719160 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.719388 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.719482 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.719704 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.719790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.720042 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.720137 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.720353 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.720441 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.720666 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.720752 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.720975 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.721063 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.721281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.721367 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.721605 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.721692 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.721921 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.722009 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.722227 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.722318 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.722646 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.722733 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.722965 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.723065 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.723293 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.723387 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.723611 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.723696 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.723926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.724021 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.724245 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.724330 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.724557 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.724648 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.724867 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.724966 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.725198 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.725300 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.725516 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.725615 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.725843 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.725933 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.726151 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.726237 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.726491 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.726582 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.726808 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.726903 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.727124 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.727251 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.727434 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.727523 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.727741 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.727829 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.728048 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.728136 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.728357 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.728443 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.728664 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.728758 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.728970 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.729055 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.729271 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.729365 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.729577 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.729662 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.729879 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.729964 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.730188 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.730288 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.730519 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.730609 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.730828 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.730913 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.731138 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.731239 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.731439 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.731524 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.731744 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.731829 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.732046 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.732141 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.732353 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.732441 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.732699 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.732800 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.732964 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.733052 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.733269 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.733362 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.733574 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.733659 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.733879 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.733965 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.734181 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.734266 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.734512 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.734614 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.734817 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.734906 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.735148 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.735234 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.735484 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.736157 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.736335 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.736423 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.736656 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.736743 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.736971 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.737072 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.737295 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.737382 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.737604 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.737690 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.737919 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.738012 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.738240 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.738333 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.738583 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.738683 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.738898 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.738999 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.739212 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.739304 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.739531 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.739618 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.739841 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.739937 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.740154 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.740240 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.740466 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.740558 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.740781 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.741118 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.741349 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.741444 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.741676 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.741771 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.742001 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.742088 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.742310 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.742456 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.742663 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.742751 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.742980 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.743076 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.743302 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.743389 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.743616 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.743715 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.743926 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.744013 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.744245 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.744338 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.744558 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.744653 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.744871 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.744956 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.745185 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.745277 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.745500 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.745599 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.745816 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.745913 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.746133 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.746221 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.746477 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.746568 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.746810 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.746909 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.747143 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.747237 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.747466 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.747554 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.747790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.747875 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.748137 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.748223 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.748450 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.748536 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.748763 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.748849 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.749075 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.749170 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.749324 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:53:59.749412 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.749712 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.750021 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:53:59.750266 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:53:59.773194 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:53:59.774631 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_db.sqlalchemy.engines [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:53:59.836523 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.context [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd26bc05-bc65-4702-9c6b-9a4ef8866b2a(cell1) {{(pid=102610) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:53:59.836765 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.context [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd26bc05-bc65-4702-9c6b-9a4ef8866b2a(cell1) {{(pid=102611) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:53:59.840855 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:53:59.841009 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_concurrency.lockutils [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:53:59.842423 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:53:59.842603 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_concurrency.lockutils [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:53:59.843232 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:53:59.843397 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_concurrency.lockutils [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:53:59.845672 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:53:59.845858 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_concurrency.lockutils [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:53:59.856581 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:53:59.859761 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:53:59.864008 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_db.sqlalchemy.engines [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:53:59.867850 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_db.sqlalchemy.engines [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:54:00.019500 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_db.sqlalchemy.engines [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:54:00.025484 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG oslo_db.sqlalchemy.engines [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:54:00.355677 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:54:00.357360 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: WARNING keystonemiddleware.auth_token [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:54:00.363560 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:54:00.365140 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: WARNING keystonemiddleware.auth_token [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:54:00.705234 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:54:00.708890 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: WARNING keystonemiddleware.auth_token [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:54:00.711256 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: WARNING keystonemiddleware.auth_token [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:54:00.714956 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: WARNING keystonemiddleware.auth_token [None req-6fbe1eec-30f0-4812-acd6-9d5cb3f73653 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:54:00.717233 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c6492959c0 pid: 102610 (default app) May 10 14:54:00.719351 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:54:00.721043 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002293 May 10 14:54:00.721460 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Tue May 10 14:54:00 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:54:00.721598 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c6492959c0 pid: 102611 (default app) May 10 14:55:18.192270 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:18.193812 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 May 10 14:55:18.195968 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 2/2] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:18.609860 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-f70a0dc3-c150-4bfb-a621-595b6c15a6d8 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:18.638861 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-f70a0dc3-c150-4bfb-a621-595b6c15a6d8 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.437710 May 10 14:55:18.639653 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 1/3] 10.222.0.83 () {60 vars in 1291 bytes} [Tue May 10 14:55:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:20.900292 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:20.901210 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-4e1a0dd5-e386-41aa-a3f0-8a591fdb0f34 None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 10 14:55:20.901772 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 3/4] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:20.965061 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-1c654364-103d-4797-a4a3-c1954a1edddc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:20.983485 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:55:20.983485 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: warnings.warn(msg) May 10 14:55:21.015549 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-1c654364-103d-4797-a4a3-c1954a1edddc admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107362 May 10 14:55:21.018435 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 2/5] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:55:21.233313 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-3dd80d4d-7373-4bbd-abef-8fcd9f4c6ab7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:21.236184 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:55:21.236184 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 10 14:55:21.286636 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-3dd80d4d-7373-4bbd-abef-8fcd9f4c6ab7 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262341 May 10 14:55:21.293985 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 4/6] 10.222.0.83 () {64 vars in 1335 bytes} [Tue May 10 14:55:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:55:23.542115 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-1c654364-103d-4797-a4a3-c1954a1edddc admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:23.543201 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-1c654364-103d-4797-a4a3-c1954a1edddc admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 10 14:55:23.543605 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 3/7] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:23.670556 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-ca7843e7-08a2-4639-9f84-7459b2f4883e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:23.688488 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:55:23.688488 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 10 14:55:23.707186 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-ca7843e7-08a2-4639-9f84-7459b2f4883e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157273 May 10 14:55:23.707753 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 5/8] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:23.719347 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-13cec2dc-cfcb-4909-ac70-b3c70683428a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:23.720831 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:55:23.720831 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: warnings.warn(msg) May 10 14:55:23.757834 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-13cec2dc-cfcb-4909-ac70-b3c70683428a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042091 May 10 14:55:23.758321 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 4/9] 10.222.0.83 () {64 vars in 1335 bytes} [Tue May 10 14:55:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:26.050199 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-ca7843e7-08a2-4639-9f84-7459b2f4883e admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:26.051325 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-ca7843e7-08a2-4639-9f84-7459b2f4883e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 May 10 14:55:26.051734 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 6/10] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:26.114572 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-68dd4dab-407a-4c2d-a734-3f32e744cced admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:26.137107 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-68dd4dab-407a-4c2d-a734-3f32e744cced admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079546 May 10 14:55:26.137749 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 5/11] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:26.150439 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-5be16d15-5d38-4674-bbf3-111d4eac2e97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:26.175277 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-5be16d15-5d38-4674-bbf3-111d4eac2e97 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028571 May 10 14:55:26.183292 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 7/12] 10.222.0.83 () {64 vars in 1335 bytes} [Tue May 10 14:55:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:28.448890 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-68dd4dab-407a-4c2d-a734-3f32e744cced admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:28.449834 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-68dd4dab-407a-4c2d-a734-3f32e744cced admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 10 14:55:28.450245 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 6/13] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:28.511961 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-03083ff0-ea0f-48a2-8219-65965e827850 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "id": "d3", "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:28.531583 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-03083ff0-ea0f-48a2-8219-65965e827850 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074203 May 10 14:55:28.532169 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 8/14] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:28.544245 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-e6e3ed60-2d33-46b7-a37a-1f912ca209f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:28.567870 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-e6e3ed60-2d33-46b7-a37a-1f912ca209f8 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027476 May 10 14:55:28.568793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 7/15] 10.222.0.83 () {64 vars in 1335 bytes} [Tue May 10 14:55:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:55:30.829435 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-03083ff0-ea0f-48a2-8219-65965e827850 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:30.830558 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-03083ff0-ea0f-48a2-8219-65965e827850 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 10 14:55:30.830980 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 9/16] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:30.892102 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-775d53f7-1d7c-4c4a-a32d-025f486d09cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "ram": 4096, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:30.911509 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-775d53f7-1d7c-4c4a-a32d-025f486d09cf admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074677 May 10 14:55:30.912313 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 8/17] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:55:30.924422 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-e15b3dc6-6b28-4bc6-80b0-697f9eb11299 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:30.947455 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-e15b3dc6-6b28-4bc6-80b0-697f9eb11299 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026963 May 10 14:55:30.948360 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 10/18] 10.222.0.83 () {64 vars in 1335 bytes} [Tue May 10 14:55:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:33.216643 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-775d53f7-1d7c-4c4a-a32d-025f486d09cf admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:33.217654 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-775d53f7-1d7c-4c4a-a32d-025f486d09cf admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 10 14:55:33.218688 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 9/19] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:33.282049 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-a4c4d628-3308-4b33-b470-7dffb0a6980e admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:33.307898 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-a4c4d628-3308-4b33-b470-7dffb0a6980e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083170 May 10 14:55:33.308883 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 11/20] 10.222.0.83 () {60 vars in 1291 bytes} [Tue May 10 14:55:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:55:35.588348 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-775d53f7-1d7c-4c4a-a32d-025f486d09cf admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:35.589626 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-775d53f7-1d7c-4c4a-a32d-025f486d09cf admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 May 10 14:55:35.590171 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 10/21] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:35.650960 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-edd0f2ae-35cf-4149-bb19-1d98628b23d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "swap": 0}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:35.673261 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-edd0f2ae-35cf-4149-bb19-1d98628b23d3 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076993 May 10 14:55:35.673952 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 12/22] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:35.688808 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-e0a59537-a8a6-479b-99d0-97c9f3885197 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:35.715426 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-e0a59537-a8a6-479b-99d0-97c9f3885197 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031697 May 10 14:55:35.716138 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 11/23] 10.222.0.83 () {64 vars in 1332 bytes} [Tue May 10 14:55:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:38.532638 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-edd0f2ae-35cf-4149-bb19-1d98628b23d3 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:38.533659 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-edd0f2ae-35cf-4149-bb19-1d98628b23d3 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 10 14:55:38.534095 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:38.600616 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-65f3ee1e-41bf-47be-8a4f-544361b42263 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "id": "2", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:38.619005 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-65f3ee1e-41bf-47be-8a4f-544361b42263 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078714 May 10 14:55:38.619863 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 12/25] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:38.631272 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-4a0fec82-70e2-4e8e-a550-ad079fd42dae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:38.657582 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-4a0fec82-70e2-4e8e-a550-ad079fd42dae admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029706 May 10 14:55:38.658410 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 14/26] 10.222.0.83 () {64 vars in 1332 bytes} [Tue May 10 14:55:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:55:41.366968 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-65f3ee1e-41bf-47be-8a4f-544361b42263 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:41.368003 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-65f3ee1e-41bf-47be-8a4f-544361b42263 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001812 May 10 14:55:41.368427 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 13/27] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:41.426505 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-c433854c-4290-40a4-b58f-cbb9add48b7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:41.444396 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-c433854c-4290-40a4-b58f-cbb9add48b7d admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068850 May 10 14:55:41.444953 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 15/28] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:41.457311 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d05f1419-35f7-4019-9526-4d3803899012 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:41.480011 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d05f1419-35f7-4019-9526-4d3803899012 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026293 May 10 14:55:41.480789 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 14/29] 10.222.0.83 () {64 vars in 1332 bytes} [Tue May 10 14:55:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:43.743252 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-c433854c-4290-40a4-b58f-cbb9add48b7d admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:43.744883 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-c433854c-4290-40a4-b58f-cbb9add48b7d admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 May 10 14:55:43.745645 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 16/30] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:43.810640 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-96ba11b5-31fc-419d-a5d1-109f9b9d1f5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:43.830029 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-96ba11b5-31fc-419d-a5d1-109f9b9d1f5e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078182 May 10 14:55:43.830599 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 15/31] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:43.842374 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-7760e995-5903-4cc8-891f-abb42cd2acd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:43.866147 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-7760e995-5903-4cc8-891f-abb42cd2acd9 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027563 May 10 14:55:43.867021 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 17/32] 10.222.0.83 () {64 vars in 1332 bytes} [Tue May 10 14:55:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:55:46.180518 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-96ba11b5-31fc-419d-a5d1-109f9b9d1f5e admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:46.181461 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-96ba11b5-31fc-419d-a5d1-109f9b9d1f5e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 10 14:55:46.181871 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 16/33] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:46.246878 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-d50dc6c6-895f-4da6-973b-25efd857d364 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:46.266231 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-d50dc6c6-895f-4da6-973b-25efd857d364 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077979 May 10 14:55:46.267036 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 18/34] 10.222.0.83 () {64 vars in 1282 bytes} [Tue May 10 14:55:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:55:46.283189 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-8a000389-1c58-49db-bcbb-f28d99c27477 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:46.305595 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-8a000389-1c58-49db-bcbb-f28d99c27477 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030371 May 10 14:55:46.306169 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 17/35] 10.222.0.83 () {64 vars in 1332 bytes} [Tue May 10 14:55:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:09.747624 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-d50dc6c6-895f-4da6-973b-25efd857d364 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:09.748673 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-d50dc6c6-895f-4da6-973b-25efd857d364 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 10 14:56:09.749078 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 19/36] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:09.805563 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-effb8808-1191-4809-b451-e3af685dba11 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:09.827311 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-effb8808-1191-4809-b451-e3af685dba11 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071911 May 10 14:56:09.828292 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 18/37] 10.222.0.83 () {60 vars in 1291 bytes} [Tue May 10 14:56:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:56:10.825653 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-d50dc6c6-895f-4da6-973b-25efd857d364 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:10.826692 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-d50dc6c6-895f-4da6-973b-25efd857d364 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 10 14:56:10.827601 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 20/38] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:11.022269 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-c4bfa4b2-1fb3-41d8-9c3e-0973102520b7 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:11.027788 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.wsgi [None req-c4bfa4b2-1fb3-41d8-9c3e-0973102520b7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-c4bfa4b2-1fb3-41d8-9c3e-0973102520b7 admin admin] Request method failure captured: May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Accept: application/json May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Accept-Encoding: gzip, deflate May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Connection: keep-alive May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Content-Length: 0 May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Host: 10.222.0.83 May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Openstack-Api-Version: compute 2.90 May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Openstack-System-Scope: None May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: User-Agent: python-novaclient May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Auth-Token: gAAAAABien0KjIt3m6vl4HYHoAynfqxylS2Auh_LJSbW2H8g8Wvty0h2sql1yn7laSiDLKf3QVyVrIf9seNW0xPPTFp8asiQ_qijDFjhIDKayzkOK8lmYXjDgHrfdKSSv1Ny3CkKrXBoHOnuxtUcVUWw60Be5GTuYatlgHxdQI4t9XLnjskVLGc May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Domain-Id: None May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Domain-Name: None May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Identity-Status: Confirmed May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Is-Admin-Project: True May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Domain-Id: default May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Domain-Name: Default May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Name: admin May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Role: admin,member,reader May 10 14:56:11.031081 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Roles: admin,member,reader May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant: admin May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant-Name: admin May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User: admin May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Domain-Id: default May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Domain-Name: Default May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Id: ce068d36274d4c2ab89128932ddb806d May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Name: admin May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: method: > May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: exception: Flavor 42 could not be found. May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: action_args: {'id': '42'} May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:56:11.032793 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:11.034520 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:11.036050 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-c4bfa4b2-1fb3-41d8-9c3e-0973102520b7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:56:11.037352 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-c4bfa4b2-1fb3-41d8-9c3e-0973102520b7 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060213 May 10 14:56:11.037352 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 19/39] 10.222.0.83 () {60 vars in 1190 bytes} [Tue May 10 14:56:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:56:11.042732 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-ed23ed2c-fd18-4246-afc4-adc81af2bebb admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:11.064171 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-ed23ed2c-fd18-4246-afc4-adc81af2bebb admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025006 May 10 14:56:11.064714 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 21/40] 10.222.0.83 () {60 vars in 1210 bytes} [Tue May 10 14:56:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:56:11.078992 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d7da24dc-7dfe-4c57-b369-0e98433d2067 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:11.100158 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d7da24dc-7dfe-4c57-b369-0e98433d2067 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025234 May 10 14:56:11.100692 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 20/41] 10.222.0.83 () {60 vars in 1210 bytes} [Tue May 10 14:56:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:56:11.109654 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-67b36941-90b8-47af-9c98-1e5afa2675fd admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:11.115084 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.wsgi [None req-67b36941-90b8-47af-9c98-1e5afa2675fd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-67b36941-90b8-47af-9c98-1e5afa2675fd admin admin] Request method failure captured: May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Accept: application/json May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Accept-Encoding: gzip, deflate May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Connection: keep-alive May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Content-Length: 0 May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Host: 10.222.0.83 May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Openstack-Api-Version: compute 2.90 May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Openstack-System-Scope: None May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: User-Agent: python-novaclient May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Auth-Token: gAAAAABien0KjIt3m6vl4HYHoAynfqxylS2Auh_LJSbW2H8g8Wvty0h2sql1yn7laSiDLKf3QVyVrIf9seNW0xPPTFp8asiQ_qijDFjhIDKayzkOK8lmYXjDgHrfdKSSv1Ny3CkKrXBoHOnuxtUcVUWw60Be5GTuYatlgHxdQI4t9XLnjskVLGc May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Domain-Id: None May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Domain-Name: None May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Identity-Status: Confirmed May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Is-Admin-Project: True May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Domain-Id: default May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Domain-Name: Default May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Name: admin May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Role: admin,member,reader May 10 14:56:11.118625 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Roles: admin,member,reader May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant: admin May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant-Name: admin May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User: admin May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Domain-Id: default May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Domain-Name: Default May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Id: ce068d36274d4c2ab89128932ddb806d May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Name: admin May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: method: > May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: exception: Flavor 42 could not be found. May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: action_args: {'id': '42'} May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:56:11.120258 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:11.121224 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:11.122281 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-67b36941-90b8-47af-9c98-1e5afa2675fd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:56:11.123331 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-67b36941-90b8-47af-9c98-1e5afa2675fd admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013899 May 10 14:56:11.123331 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 22/42] 10.222.0.83 () {60 vars in 1190 bytes} [Tue May 10 14:56:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 14:56:12.000363 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d7da24dc-7dfe-4c57-b369-0e98433d2067 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:12.001394 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d7da24dc-7dfe-4c57-b369-0e98433d2067 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 10 14:56:12.001792 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 21/43] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:12.195692 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-5bcfbfe6-6c5b-46ef-9e64-120e8c2f7af8 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:12.200858 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.wsgi [None req-5bcfbfe6-6c5b-46ef-9e64-120e8c2f7af8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-5bcfbfe6-6c5b-46ef-9e64-120e8c2f7af8 admin admin] Request method failure captured: May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Accept: application/json May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Accept-Encoding: gzip, deflate May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Connection: keep-alive May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Content-Length: 0 May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Host: 10.222.0.83 May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Openstack-Api-Version: compute 2.90 May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Openstack-System-Scope: None May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: User-Agent: python-novaclient May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Auth-Token: gAAAAABien0LEjtBVcLHk466yi_XGkNZyMWeH0RVubApBitc4KBWg7H-_VrVi4W3V55ZZ2y_HNM2VGMdIPLHEsCkSe-cSR_oE1K0IzPgxlLPeSGX4EFKUV44O00yG49fkpE_rLOyWlVIaIWmyPWEnuFFeNtwicwmUGgfHaJzJcBfKk7meqjehl8 May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Domain-Id: None May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Domain-Name: None May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Identity-Status: Confirmed May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Is-Admin-Project: True May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Domain-Id: default May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Domain-Name: Default May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Name: admin May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Role: admin,member,reader May 10 14:56:12.202926 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Roles: admin,member,reader May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant: admin May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant-Name: admin May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User: admin May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Domain-Id: default May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Domain-Name: Default May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Id: ce068d36274d4c2ab89128932ddb806d May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Name: admin May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: method: > May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: exception: Flavor 84 could not be found. May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: action_args: {'id': '84'} May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:56:12.204450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:12.205431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:12.206745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-5bcfbfe6-6c5b-46ef-9e64-120e8c2f7af8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:56:12.208169 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-5bcfbfe6-6c5b-46ef-9e64-120e8c2f7af8 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058229 May 10 14:56:12.208169 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 23/44] 10.222.0.83 () {60 vars in 1190 bytes} [Tue May 10 14:56:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:56:12.214033 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-b247fd5e-5f51-49d0-9a06-b206e449cf2f admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:12.227292 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-b247fd5e-5f51-49d0-9a06-b206e449cf2f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016814 May 10 14:56:12.227819 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 22/45] 10.222.0.83 () {60 vars in 1210 bytes} [Tue May 10 14:56:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:56:12.237575 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-d9fc14d6-2481-4949-8f53-2bc23a281067 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:12.251823 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-d9fc14d6-2481-4949-8f53-2bc23a281067 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017740 May 10 14:56:12.252345 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1210 bytes} [Tue May 10 14:56:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:56:12.261082 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-78839cd7-99cb-40fe-96cd-986e7006ab2c admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:12.266261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.wsgi [None req-78839cd7-99cb-40fe-96cd-986e7006ab2c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-78839cd7-99cb-40fe-96cd-986e7006ab2c admin admin] Request method failure captured: May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Accept: application/json May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Accept-Encoding: gzip, deflate May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Connection: keep-alive May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Content-Length: 0 May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Host: 10.222.0.83 May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Openstack-Api-Version: compute 2.90 May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Openstack-System-Scope: None May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: User-Agent: python-novaclient May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Auth-Token: gAAAAABien0LEjtBVcLHk466yi_XGkNZyMWeH0RVubApBitc4KBWg7H-_VrVi4W3V55ZZ2y_HNM2VGMdIPLHEsCkSe-cSR_oE1K0IzPgxlLPeSGX4EFKUV44O00yG49fkpE_rLOyWlVIaIWmyPWEnuFFeNtwicwmUGgfHaJzJcBfKk7meqjehl8 May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Domain-Id: None May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Domain-Name: None May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Identity-Status: Confirmed May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Is-Admin-Project: True May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Domain-Id: default May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Domain-Name: Default May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Name: admin May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Role: admin,member,reader May 10 14:56:12.267790 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Roles: admin,member,reader May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant: admin May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant-Name: admin May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User: admin May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Domain-Id: default May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Domain-Name: Default May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Id: ce068d36274d4c2ab89128932ddb806d May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Name: admin May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: method: > May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: exception: Flavor 84 could not be found. May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: action_args: {'id': '84'} May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:56:12.269327 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:12.270296 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:12.271803 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-78839cd7-99cb-40fe-96cd-986e7006ab2c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:56:12.273137 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-78839cd7-99cb-40fe-96cd-986e7006ab2c admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011498 May 10 14:56:12.273137 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 23/47] 10.222.0.83 () {60 vars in 1190 bytes} [Tue May 10 14:56:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:56:13.144532 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-d9fc14d6-2481-4949-8f53-2bc23a281067 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:13.145529 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-d9fc14d6-2481-4949-8f53-2bc23a281067 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 10 14:56:13.145923 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 25/48] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:13.330636 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-18f0c271-39c4-4011-88be-bed3caca8448 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:13.336299 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.wsgi [None req-18f0c271-39c4-4011-88be-bed3caca8448 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-18f0c271-39c4-4011-88be-bed3caca8448 admin admin] Request method failure captured: May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Accept: application/json May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Accept-Encoding: gzip, deflate May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Connection: keep-alive May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Content-Length: 0 May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Host: 10.222.0.83 May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Openstack-Api-Version: compute 2.90 May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Openstack-System-Scope: None May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: User-Agent: python-novaclient May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Auth-Token: gAAAAABien0N3UuKkc9_4nQvy7SA4c83qYEycLh0Xq3oOXyDE5hYaG68-DKKDcz6WQ0U-SSjzm9IFkN_v7FiV3kao5B4fQpIyUGugCNdDQQ8EnLTSuen8OpF1CXHjxECZT4jAYI6f1Wom2mhHWGAP_XDPCzqX7kJBI7q_Ixk5qcovYE4cdLiY2s May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Domain-Id: None May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Domain-Name: None May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Identity-Status: Confirmed May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Is-Admin-Project: True May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Domain-Id: default May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Domain-Name: Default May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Project-Name: admin May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Role: admin,member,reader May 10 14:56:13.337774 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Roles: admin,member,reader May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant: admin May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-Tenant-Name: admin May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User: admin May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Domain-Id: default May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Domain-Name: Default May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Id: ce068d36274d4c2ab89128932ddb806d May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: X-User-Name: admin May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: method: > May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: exception: Flavor 451 could not be found. May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: action_args: {'id': '451'} May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:56:13.339297 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:13.340166 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: ERROR nova.api.openstack.wsgi May 10 14:56:13.341261 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-18f0c271-39c4-4011-88be-bed3caca8448 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:56:13.342281 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-18f0c271-39c4-4011-88be-bed3caca8448 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058217 May 10 14:56:13.342281 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 24/49] 10.222.0.83 () {60 vars in 1193 bytes} [Tue May 10 14:56:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:56:13.349248 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-e0d7cf4a-da78-4dbc-8ead-fbb3ba8fe019 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:13.363057 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-e0d7cf4a-da78-4dbc-8ead-fbb3ba8fe019 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017398 May 10 14:56:13.363576 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 26/50] 10.222.0.83 () {60 vars in 1210 bytes} [Tue May 10 14:56:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:56:13.372808 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:13.386104 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016861 May 10 14:56:13.386660 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 25/51] 10.222.0.83 () {60 vars in 1210 bytes} [Tue May 10 14:56:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:56:13.395199 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-0c7a9fb5-f3ef-4b8f-987f-584b34373923 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:13.400127 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.wsgi [None req-0c7a9fb5-f3ef-4b8f-987f-584b34373923 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-0c7a9fb5-f3ef-4b8f-987f-584b34373923 admin admin] Request method failure captured: May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Accept: application/json May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Accept-Encoding: gzip, deflate May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Connection: keep-alive May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Content-Length: 0 May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Host: 10.222.0.83 May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Openstack-Api-Version: compute 2.90 May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Openstack-System-Scope: None May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: User-Agent: python-novaclient May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Auth-Token: gAAAAABien0N3UuKkc9_4nQvy7SA4c83qYEycLh0Xq3oOXyDE5hYaG68-DKKDcz6WQ0U-SSjzm9IFkN_v7FiV3kao5B4fQpIyUGugCNdDQQ8EnLTSuen8OpF1CXHjxECZT4jAYI6f1Wom2mhHWGAP_XDPCzqX7kJBI7q_Ixk5qcovYE4cdLiY2s May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Domain-Id: None May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Domain-Name: None May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Identity-Status: Confirmed May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Is-Admin-Project: True May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Domain-Id: default May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Domain-Name: Default May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Project-Name: admin May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Role: admin,member,reader May 10 14:56:13.401594 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Roles: admin,member,reader May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/06d48372060e456ea0c20a517b83a4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant: admin May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant-Id: 06d48372060e456ea0c20a517b83a4d3 May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-Tenant-Name: admin May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User: admin May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Domain-Id: default May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Domain-Name: Default May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Id: ce068d36274d4c2ab89128932ddb806d May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: X-User-Name: admin May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: method: > May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: exception: Flavor 451 could not be found. May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: action_args: {'id': '451'} May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:56:13.403217 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:13.404346 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: ERROR nova.api.openstack.wsgi May 10 14:56:13.406450 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-0c7a9fb5-f3ef-4b8f-987f-584b34373923 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:56:13.407717 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-0c7a9fb5-f3ef-4b8f-987f-584b34373923 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011123 May 10 14:56:13.407717 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 27/52] 10.222.0.83 () {60 vars in 1193 bytes} [Tue May 10 14:56:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:56:14.288649 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:14.289709 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 10 14:56:14.290104 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:14.475084 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-f4c919d4-6fc7-4821-a542-28fd9633863e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:14.492887 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-f4c919d4-6fc7-4821-a542-28fd9633863e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.066743 May 10 14:56:14.493424 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 28/54] 10.222.0.83 () {64 vars in 1235 bytes} [Tue May 10 14:56:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:56:15.369489 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:15.370531 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 10 14:56:15.370935 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:15.555708 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-0a2c6718-2b87-4f6d-b1e8-a9f58d658bc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:15.573105 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-0a2c6718-2b87-4f6d-b1e8-a9f58d658bc4 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066983 May 10 14:56:15.573685 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 29/56] 10.222.0.83 () {64 vars in 1235 bytes} [Tue May 10 14:56:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:56:16.460448 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:16.461457 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 10 14:56:16.461890 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 28/57] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:16.647709 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-4e020f6d-3791-4a9e-ae4d-85b31e5ac61a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:16.664985 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-4e020f6d-3791-4a9e-ae4d-85b31e5ac61a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067616 May 10 14:56:16.665540 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 30/58] 10.222.0.83 () {64 vars in 1235 bytes} [Tue May 10 14:56:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:56:17.541719 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:17.542794 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 10 14:56:17.543229 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 29/59] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:17.728930 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-68c13e5e-45ac-4982-8dd5-f9ca228b0366 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:17.746250 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-68c13e5e-45ac-4982-8dd5-f9ca228b0366 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067923 May 10 14:56:17.747002 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 31/60] 10.222.0.83 () {64 vars in 1235 bytes} [Tue May 10 14:56:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:56:18.631659 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:18.632654 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 10 14:56:18.633049 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 30/61] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 14:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:18.818066 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-5d46d6fa-3f03-4e11-9aa1-51252c539c69 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:18.837023 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-5d46d6fa-3f03-4e11-9aa1-51252c539c69 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068555 May 10 14:56:18.837564 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 32/62] 10.222.0.83 () {60 vars in 1202 bytes} [Tue May 10 14:56:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:57:20.750808 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:57:20.751834 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-2926b0bd-46dd-4cf5-8013-eac85ad6720b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 10 14:57:20.752231 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 31/63] 10.222.0.83 () {54 vars in 930 bytes} [Tue May 10 14:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:57:20.808034 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-43ad4590-05fe-4f60-8dc5-f4eff9e5541b admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:57:20.827431 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-43ad4590-05fe-4f60-8dc5-f4eff9e5541b admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069351 May 10 14:57:20.827971 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 33/64] 10.222.0.83 () {60 vars in 1291 bytes} [Tue May 10 14:57:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:57:20.851332 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-c80f371f-0a17-40f9-afab-1bf9ece5a385 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:57:20.858882 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-c80f371f-0a17-40f9-afab-1bf9ece5a385 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011824 May 10 14:57:20.859405 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 32/65] 10.222.0.83 () {60 vars in 1282 bytes} [Tue May 10 14:57:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:57:20.870765 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-ce9a8314-0bdc-4cea-a596-3b56f1dba30c admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:57:20.878764 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-ce9a8314-0bdc-4cea-a596-3b56f1dba30c admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011820 May 10 14:57:20.879285 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 34/66] 10.222.0.83 () {60 vars in 1285 bytes} [Tue May 10 14:57:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:57:20.890379 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:57:20.897603 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011201 May 10 14:57:20.898109 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 33/67] 10.222.0.83 () {60 vars in 1285 bytes} [Tue May 10 14:57:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:57:20.908921 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-4caff241-7a6a-4b46-af37-f6b68495c288 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:57:20.916812 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-4caff241-7a6a-4b46-af37-f6b68495c288 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011259 May 10 14:57:20.917210 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 35/68] 10.222.0.83 () {60 vars in 1282 bytes} [Tue May 10 14:57:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:00:47.830139 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:00:47.831177 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 10 15:00:47.831578 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 34/69] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 15:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:00:48.094986 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-31327d6b-14ac-4f18-ac00-4634714da766 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:00:48.096147 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 15:00:48.096147 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 10 15:00:48.097387 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-31327d6b-14ac-4f18-ac00-4634714da766 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:00:48.097819 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-31327d6b-14ac-4f18-ac00-4634714da766 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:00:48.098630 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-31327d6b-14ac-4f18-ac00-4634714da766 admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:00:48.099057 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-31327d6b-14ac-4f18-ac00-4634714da766 admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:00:48.132285 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-31327d6b-14ac-4f18-ac00-4634714da766 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145094 May 10 15:00:48.132829 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 36/70] 10.222.0.83 () {60 vars in 1193 bytes} [Tue May 10 15:00:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:00:49.034926 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:00:49.036007 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 May 10 15:00:49.036440 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 35/71] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 15:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:00:49.227007 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-5964cea8-ba26-4323-912d-a9ad5a58113c admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:00:49.228214 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 15:00:49.228214 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 10 15:00:49.229470 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-5964cea8-ba26-4323-912d-a9ad5a58113c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:00:49.229906 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-5964cea8-ba26-4323-912d-a9ad5a58113c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:00:49.230727 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-5964cea8-ba26-4323-912d-a9ad5a58113c admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:00:49.231149 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-5964cea8-ba26-4323-912d-a9ad5a58113c admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:00:49.250304 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-5964cea8-ba26-4323-912d-a9ad5a58113c admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076236 May 10 15:00:49.250872 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 37/72] 10.222.0.83 () {60 vars in 1193 bytes} [Tue May 10 15:00:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:01:00.568091 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:00.569099 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 10 15:01:00.569499 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 15:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:01:00.761824 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-ecb1f27f-cd69-454e-a5db-d268ba7d3083 admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:00.763054 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 15:01:00.763054 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 10 15:01:00.764309 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-ecb1f27f-cd69-454e-a5db-d268ba7d3083 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:00.764745 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-ecb1f27f-cd69-454e-a5db-d268ba7d3083 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:00.765521 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-ecb1f27f-cd69-454e-a5db-d268ba7d3083 admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:00.765978 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-ecb1f27f-cd69-454e-a5db-d268ba7d3083 admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:00.789470 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-ecb1f27f-cd69-454e-a5db-d268ba7d3083 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078212 May 10 15:01:00.790009 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 38/74] 10.222.0.83 () {60 vars in 1193 bytes} [Tue May 10 15:01:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:01:01.677385 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: DEBUG nova.api.openstack.wsgi [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] Calling method '>' {{(pid=102611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:01.678470 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: INFO nova.api.openstack.requestlog [None req-d9ff9043-782c-4292-b7dd-28635941eb09 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 10 15:01:01.678875 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: [pid: 102611|app: 0|req: 37/75] 10.222.0.83 () {56 vars in 1074 bytes} [Tue May 10 15:01:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:01:01.869057 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG nova.api.openstack.wsgi [None req-3a7772fd-5c1a-432b-9b1e-f841595c68ed admin admin] Calling method '>' {{(pid=102610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:01.870492 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 15:01:01.870492 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: warnings.warn(msg) May 10 15:01:01.871848 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-3a7772fd-5c1a-432b-9b1e-f841595c68ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:01.872287 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-3a7772fd-5c1a-432b-9b1e-f841595c68ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:01.873106 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-3a7772fd-5c1a-432b-9b1e-f841595c68ed admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:01.873534 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: DEBUG oslo_concurrency.lockutils [None req-3a7772fd-5c1a-432b-9b1e-f841595c68ed admin admin] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:01.895238 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: INFO nova.api.openstack.requestlog [None req-3a7772fd-5c1a-432b-9b1e-f841595c68ed admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076528 May 10 15:01:01.895715 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: [pid: 102610|app: 0|req: 39/76] 10.222.0.83 () {60 vars in 1193 bytes} [Tue May 10 15:01:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:02:03.216591 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: Tue May 10 15:02:03 2022 - graceful shutdown triggered... May 10 15:02:03.216342 dv-cinder-839628-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 15:02:03.217655 dv-cinder-839628-2-iscsi devstack@n-api.service[102611]: Gracefully killing worker 2 (pid: 102611)... May 10 15:02:03.218027 dv-cinder-839628-2-iscsi devstack@n-api.service[102610]: Gracefully killing worker 1 (pid: 102610)... May 10 15:02:04.217423 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: worker 1 buried after 1 seconds May 10 15:02:04.217423 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: worker 2 buried after 1 seconds May 10 15:02:04.217423 dv-cinder-839628-2-iscsi devstack@n-api.service[102609]: goodbye to uWSGI. May 10 15:02:04.218927 dv-cinder-839628-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 15:02:04.219531 dv-cinder-839628-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 15:02:04.222221 dv-cinder-839628-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 15:02:04.237694 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 15:02:04 2022] *** May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: nodename: dv-cinder-839628-2-iscsi May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: machine: x86_64 May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: clock source: unix May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: pcre jit disabled May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: detected number of CPU cores: 4 May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: current working directory: / May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: detected binary path: /usr/bin/uwsgi-core May 10 15:02:04.261306 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: your processes number limit is 47680 May 10 15:02:04.262067 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: your memory page size is 4096 bytes May 10 15:02:04.262067 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: detected max file descriptor number: 2048 May 10 15:02:04.262067 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: lock engine: pthread robust mutexes May 10 15:02:04.262067 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: thunder lock: enabled May 10 15:02:04.262067 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 15:02:04.262067 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 15:02:04.308101 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: Python main interpreter initialized at 0x555e6a8b89c0 May 10 15:02:04.308101 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: python threads support enabled May 10 15:02:04.308101 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: your server socket listen backlog is limited to 100 connections May 10 15:02:04.308101 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: your mercy for graceful operations on workers is 90 seconds May 10 15:02:04.308575 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: mapped 403077 bytes (393 KB) for 2 cores May 10 15:02:04.308575 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: *** Operational MODE: preforking *** May 10 15:02:04.308806 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: *** uWSGI is running in multiple interpreter mode *** May 10 15:02:04.308806 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: spawned uWSGI master process (pid: 117152) May 10 15:02:04.309009 dv-cinder-839628-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 15:02:04.310142 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: spawned uWSGI worker 1 (pid: 117167, cores: 1) May 10 15:02:04.310142 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: spawned uWSGI worker 2 (pid: 117168, cores: 1) May 10 15:02:04.310142 dv-cinder-839628-2-iscsi devstack@n-api.service[117152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 15:02:05.539283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 15:02:05.545933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 15:02:06.344664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 15:02:06.344664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: from cryptography.utils import int_from_bytes May 10 15:02:06.344947 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 15:02:06.344947 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: from cryptography.utils import int_from_bytes May 10 15:02:06.346743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 15:02:06.346743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: from cryptography.utils import int_from_bytes May 10 15:02:06.347070 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 15:02:06.347070 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: from cryptography.utils import int_from_bytes May 10 15:02:08.771860 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 15:02:08.772401 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 15:02:08.772686 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 15:02:08.772947 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 15:02:08.773209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 15:02:08.773599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.773932 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.774261 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.774613 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.774949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.775268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.775611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.775961 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.776295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.776562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.776885 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.777214 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839628-2-iscsi {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.777545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.777858 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.778176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.778525 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.778841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.779168 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.779480 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.779984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.781980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.781980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.781980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.781980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.781980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.782382 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.782661 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.782981 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.783315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.783634 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.784041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839628-2-iscsi {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.784365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.784687 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.785023 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.785424 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.785742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.786083 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.786397 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.786754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.787066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.787397 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.787733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.788046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.788369 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.788692 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.788992 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.789306 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.789628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.789937 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.790249 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.790539 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.790848 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.791176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.792035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.792367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.792624 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.792881 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.793312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.793533 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.793847 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.794160 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.794514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.794813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.795125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.795436 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.795749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.796060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.796385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.796701 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.797028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.797341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.797664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.798070 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.798329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.798673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.799021 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.799349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.799662 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.799991 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.800316 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.800630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.800944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.801253 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.801578 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.801903 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.802211 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.802489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.802800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.803109 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.803438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.803746 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.804059 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.804369 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.804673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.804984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.805294 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.805601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.805910 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.806219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.806558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.806889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.807744 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.808058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.808382 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.808705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.809018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.809349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.809635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.809946 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.810269 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.810607 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.810924 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.811249 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.811561 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.811874 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.812197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.812508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.812820 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.813143 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.813459 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.814110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.814110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.814458 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.814821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.814982 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.815298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.815607 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.815914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.816225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.816544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.816844 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.817166 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.817492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.817807 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.818118 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.818451 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.818624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 15:02:08.819121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.819279 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 15:02:08.819444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.819664 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 15:02:08.819814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.819984 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 15:02:08.820138 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.820290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 15:02:08.820444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.820596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.820743 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.820921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.821147 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.821298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.821448 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.821600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.821763 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.821917 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.822073 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.822218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.822362 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.823045 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.823205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.823359 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.823529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.823758 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.823918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.824070 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.824234 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.824379 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.824533 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.824686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839628-2-iscsi {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.825058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.825225 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.825485 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.825666 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.825911 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.826062 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.826218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.826373 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.826568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.826725 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.826895 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.827124 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.827338 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.827498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.827651 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.827651 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.827931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.828096 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.828251 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.828410 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.828592 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.828742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.828908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.829055 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.829212 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.829367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.829518 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.829691 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.829907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.830077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.830235 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.830404 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.830567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.830721 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.830873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.831040 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.831280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.831441 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.831593 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839628-2-iscsi {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.831746 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.831906 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.832090 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.832236 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.832388 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.832533 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.832676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.832829 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.832993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.833140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.833285 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.833429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.833573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.833747 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.833968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.834123 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.834268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.834449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.834612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.834767 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.834940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.835325 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.835491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.835733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.835918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.836171 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.836322 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.836475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.836631 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.836776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.836933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.836933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.837313 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.837465 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.837620 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.837765 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.837925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.838077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.838270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.838270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.839103 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.839267 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.839429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.839574 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.839719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.839862 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.840115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.840280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.840431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.840575 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.840731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.840875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.841027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.841182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.841410 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.841567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.841716 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.841860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.842097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.842244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.842427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.842590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.842745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.842889 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.843046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.843198 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.843351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.843502 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.843647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.843791 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.843965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.844204 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.844366 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.844520 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.844666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.844817 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.844971 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.845134 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.845495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.845640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.845903 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.846063 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.846312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.846531 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.846690 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.846845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.846992 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.847151 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.847323 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.847551 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.847702 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.847852 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.847997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.848155 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.848350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.848501 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.848664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.851605 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.851783 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.851954 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.852116 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.852282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.852438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.852585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.852731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.852883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.853039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.853185 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.853330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.853495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.853652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.853838 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.854017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.854877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.855052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.855208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.855586 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.855751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.856151 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.856331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.856574 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.856733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.856904 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.857065 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.857212 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.857364 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.857529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.857746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.858028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.858203 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.858354 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.858534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.858680 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.858835 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.859000 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.859161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.859315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.859461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.859606 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.859757 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.859915 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.860067 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.860220 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.860372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.860525 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.860764 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.860928 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.861086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.861238 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.861390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.861536 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.861771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.861939 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.862085 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.862240 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.862627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.862787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.862934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.863089 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.863235 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.863398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.863559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.863715 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.863859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.864010 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.864155 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.864300 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.864461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.864615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.864761 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.865004 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.865156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.865311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.865708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.865875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.866021 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.866196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.866451 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.866639 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.866888 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.867039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.867184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.867337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.867489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.867643 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.867883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.868054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.868201 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.868345 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.868489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.868643 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.868799 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.868957 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.869102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.869246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.869443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.869603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.869755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.869901 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.870064 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.870210 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.870364 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.870816 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.871040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.871198 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.871344 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.871497 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.871652 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.871652 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.872033 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.872033 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.872322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 15:02:08.872467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.872624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.872845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.873019 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.873170 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.873324 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.873480 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.873626 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.873769 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.873921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.874076 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.874221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.874487 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.874650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.874798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.874949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.875184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.875333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.875492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.875663 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.876039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.876194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.876342 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.876596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.876770 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.876937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.877178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.877329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.877483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.877642 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.877789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.878014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.878165 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.878310 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.878508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.878667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.878812 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.878974 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.879121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.879272 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.879426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.879582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.879734 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.879896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.880158 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.880375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.880528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.880682 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.880829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.880829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.881202 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.881361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.881523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.881678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.881830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.882068 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.882218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.882363 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.882550 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.882699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.882843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.882994 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.883141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.883303 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.883458 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.883613 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.883758 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.884446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.884601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.884749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.884908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.885650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.885832 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.886189 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.886336 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.886529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.886806 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.886959 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887464 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887735 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887822 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.887916 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888386 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888780 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.888966 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889150 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889780 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889872 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889965 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.889965 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890128 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890230 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890419 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890520 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890614 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890706 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.890986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891078 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891302 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891465 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891554 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891734 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891833 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.891920 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892019 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892128 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892314 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892822 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.892918 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893006 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893099 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893198 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893291 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893386 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893567 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893662 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.893995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.894452 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.894545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.894545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.894545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.894545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.894545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.894937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.895714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.896433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.897078 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.897078 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.897078 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.897499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.897609 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.897705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.897943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.898046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.898265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.898559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.898670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.898917 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.899187 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.899281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.899846 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.899972 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.900063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.900155 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.900341 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.900444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.901411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.901531 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.901624 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.901898 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.902088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.902196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.902541 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.902736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.902843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.903155 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.903255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.903489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.903762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.903857 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.904106 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.904344 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.904444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.904715 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.904940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.905041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.905321 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.905517 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.905635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912548 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912646 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.912955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913048 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913220 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913679 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913771 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913863 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.913963 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914150 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914237 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914328 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914328 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914541 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914639 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914819 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.914916 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915559 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.915646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.919546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.919665 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.919759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.919759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.919940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920402 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920963 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.920963 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921125 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921217 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921617 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921709 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921803 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.921897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.922001 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.922459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.922554 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.922651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.922739 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.922834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.922922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923177 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.923894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.924476 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.924476 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.924757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.925072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.925388 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.926150 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.926150 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.926322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.926449 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.926649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.926914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.927022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.927265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.927521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.927686 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.928002 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.928093 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.928318 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.928635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.928729 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.928944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.929226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.929853 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.929853 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.930043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.930142 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.930142 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.930318 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.930508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.930787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.930928 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.931112 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.931418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.931513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.931742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.932048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.932293 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.932587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.932684 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.932780 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.933135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.933247 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.933509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.933738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.933830 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.934140 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.934337 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.934492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.934820 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.934912 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.935129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.935431 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.935532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.935749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.936014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.936115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.936389 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.936609 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.936718 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.937009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.937214 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.937308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.937628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.937810 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.937953 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.938271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.938370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.938639 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.939235 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.939333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.939421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.939555 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.940078 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.940190 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.940280 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.940374 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.940605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.940698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.941104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.941197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.941480 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.941707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.941801 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.942099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.942489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.942821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.942928 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.943017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.943111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.943369 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.943472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.943685 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.943962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.944057 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.944288 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.944554 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.944648 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.944909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.945126 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.945219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.945542 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.945704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.945867 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.946195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.946286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.946539 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.946801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.946914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.947169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.947382 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.947995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.948308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.948519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.948630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.948948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.949116 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.949257 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.949584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.949766 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.950251 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.950355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.950475 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.950564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.950788 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.950897 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.951228 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.951328 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.951552 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.951836 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.951940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.952194 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.952707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.953022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.953131 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.953222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.953222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.953389 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.953528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.953692 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.954240 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.954353 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.954479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.954643 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.954744 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.954953 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.955240 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.955334 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.955572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.955746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.955879 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.956192 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.956306 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.956504 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.956702 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.956797 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.957110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.957202 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.957417 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.957646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.957751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.958061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.958232 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.958432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.958578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.958745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.958850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.959072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.959408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.959685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.959780 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.960027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.960151 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.960351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.960461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.960671 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.960772 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.960992 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.961093 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.961313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.961407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.961631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.961724 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.961948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.962049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.962270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.962365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.962617 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.962740 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.962936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.963064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.963803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.963918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.964126 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.964246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.964457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.964698 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.965031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.965132 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.965354 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.965458 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.965675 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.965776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.965995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.966090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.966313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.966493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.966660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.966755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.966978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.967081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.967295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.967390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.967610 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.967712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.967924 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.968032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.968255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.968357 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.968566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.968660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.968880 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.968975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.969200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.969302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.969515 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.969620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.969827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.969922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.970158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.970276 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.970595 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.970699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.970787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.970872 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.971068 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.971163 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.971376 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.971478 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.971687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.971782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.972007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.972101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.972318 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.972413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.972637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.972747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.972948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.973110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.973262 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.973355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.973575 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.973676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.973890 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.974008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.974201 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.974316 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.974531 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.974630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.974849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.974958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.975179 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.975273 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.975516 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.975610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.975840 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.975948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.976159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.976253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.976477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.976569 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.976784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.976888 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.977111 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.977310 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.977411 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.977630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.977733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.977968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.978112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.978295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.978404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.978713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.979054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.979369 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.979477 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.979679 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.979813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.980006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.980141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.980326 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.980694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.980784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.980874 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.980949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.981089 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.981193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.981409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.981514 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.981729 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.981813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.982425 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.982546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.982546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.982855 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.982987 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.983341 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.983446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.983544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.983632 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.983781 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.983875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.984090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.984186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.984736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.984851 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.985008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.985211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.985330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.985532 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.985663 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.985850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.985996 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.986173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.986321 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.986517 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.986670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.986830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.987000 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.987162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.987314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.987479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.987624 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.987790 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.987945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.988101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.988261 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.988417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.988571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.988728 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.988881 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.989037 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.989197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.989353 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.989515 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.989682 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.989824 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.990005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.990139 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.990315 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.990578 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.990832 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.990923 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.991008 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.991101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.991254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.991436 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.991566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.991705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.991880 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.992022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.992188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.992333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.992496 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.992640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.992803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.992948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.993111 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.993256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.993498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.993591 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.993729 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.993872 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.994043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.994185 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.994383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.994561 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.994705 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.994880 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.995016 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.995190 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.995365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.995505 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.995928 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.996135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.996310 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.996464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.996862 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.996975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.997073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.997168 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.997264 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.997380 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.997540 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.997699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.997857 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.998026 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.998178 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.998345 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.998513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.998699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.998835 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.999052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.999163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.999373 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.999475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.999749 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:08.999919 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.000056 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.000261 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.000378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.000594 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.000742 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.000937 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.001058 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.001274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.001374 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.001588 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.001689 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.001902 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.002005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.002217 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.002319 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.002581 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.002903 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.003224 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.003544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.003649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.003864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.003967 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.004182 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.004320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.004500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.004594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.004815 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.004908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.005132 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.005239 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.005447 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.005542 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.005762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.005866 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.006075 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.006183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.006411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.006510 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.006734 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.006829 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.007049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.007151 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.007367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.007463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.007680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.007775 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.008010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.008115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.008326 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.008428 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.008636 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.008737 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.008949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.009041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.009255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.009360 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.009570 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.009669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.009879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.010497 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.010769 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.011017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.011113 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.011215 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.011381 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.011475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.011754 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.011847 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.012071 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.012237 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.012386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.012488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.012737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.012831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.013051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.013163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.013357 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.013457 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.013694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.013798 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.014009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.014128 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.014345 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.014537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.014693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.014792 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.014999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.015093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.015312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.015405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.015624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.015726 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.015949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.016045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.016255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.016350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.016562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.016662 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.016869 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.016964 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.017191 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.017295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.017495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.017598 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.017817 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.017911 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.018125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.018218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.018456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.018568 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.018776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.018878 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.019084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.019253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.019394 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.019566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.019701 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.019929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.020024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.020260 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.020367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.020585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.020687 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.020904 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.021028 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.021212 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.021333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.021515 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.021614 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.021821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.021958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.022131 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.022241 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.022467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.022564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.022777 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.022872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.023088 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.023200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.023395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.023489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.023792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.024006 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.024108 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.024339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.024439 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.024663 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.024757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.024985 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.025090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.025314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.025407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.025651 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.025773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.026515 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.026631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.026835 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.026929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.027162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.027279 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.027489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.027597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.027809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.027909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.028124 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.028218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.028430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.028530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.028740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.028841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.029065 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.029160 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.029374 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.029483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.029688 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.029787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.029999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.030092 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.030312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.030462 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.030646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.030750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.030956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.031111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.031285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.031393 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.031590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.031699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.031915 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.032140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.032244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.032466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.032568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.032795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.032889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.033154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.033258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.033465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.033567 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.033790 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.033902 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.034113 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.034459 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.034723 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.034858 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.035039 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.035140 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.035356 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.035457 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.035666 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.035767 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.036014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.036118 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.036324 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.036419 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.036649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.036746 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.036989 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.037111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.037327 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.037429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.037643 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.037751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.037982 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.038096 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.038311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.038426 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.038657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.038768 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.038970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.039088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.039219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 15:02:09.039314 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.039589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.039898 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.040211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.040521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.040830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.041141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.041481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.041789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.042136 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.042464 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.042793 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.043101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.043424 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.043735 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.044043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.044352 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.044659 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.045004 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.045317 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.045650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.045970 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.046291 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.046651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.046966 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.047293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.047615 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.047934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.048256 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.048576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.048895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.049215 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.049534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.049845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.050163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.050504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.050827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.051389 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.051720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.052039 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.052355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.052673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.052990 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.053306 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.053620 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.053935 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.054248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.054584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.054919 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.055250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.055578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.055914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.056233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.056543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.056878 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.057208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.057971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.058191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.058521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.058865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.059163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.059483 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.059800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.060536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.060536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.060730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.061069 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.061373 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.061690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.062007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.062334 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.062697 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.062804 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_db.sqlalchemy.engines [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.063022 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.063339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.063655 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.063977 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.064527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.064843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.065178 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.065619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.065938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.066155 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.066499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.066833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.067140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.067449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.067765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.068076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.068381 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.068708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.069019 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.069326 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.069647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.069958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.070517 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.070873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.071191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.071519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.071845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.072162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.072470 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.073352 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.073664 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.073973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.074298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.074651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.074936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.075249 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.075564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.075880 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.076187 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.076498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.076805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.077132 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.077439 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.077759 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.078049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.078361 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.078691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.078997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.079302 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.079608 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.079921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.080230 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.080538 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.080844 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.081154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.081458 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.081770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.082134 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.082482 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.082791 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.083097 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.083416 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.083728 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.084048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.084404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.084669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.085018 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.085343 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.085883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.086219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.086564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.086899 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.087231 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.087541 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.087849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.088228 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.089064 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.089383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.089703 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.090018 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.090332 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.090671 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.090986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.091300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.091614 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.091930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.092243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.092556 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.092867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.093184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.093529 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.093854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.094174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.094521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.094840 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.095154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.095472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.095788 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.096104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.096424 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.096756 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.097072 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.097377 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.097807 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.098125 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.098471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.098798 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.099113 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.099435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.099759 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.100073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.100396 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.100711 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.101041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.101385 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.101713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.102043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.102349 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.102681 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.102989 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.103301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.103620 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.103973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.104283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.104593 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.104905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.105215 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.105523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.105828 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.106132 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.106466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.106776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.107081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.107385 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.107689 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.107994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.108300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.108609 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.108915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.109221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.109525 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.109830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.110135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.110488 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.110823 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.111145 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.111472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.111786 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.112112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.112422 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.112743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.113065 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.113381 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.113692 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.114026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.114339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.114683 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.114986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.115307 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.115621 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.115934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.116261 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.116587 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.116897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.117223 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.117540 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.117864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.118252 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.118527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.118861 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.119177 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.119518 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.119838 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.120154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.120470 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.121043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.121365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.121695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.122025 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.122356 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.122709 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.123059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.123375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.123723 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.124056 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.124372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.124686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.124995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 15:02:09.125247 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 15:02:09.127277 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.context [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd26bc05-bc65-4702-9c6b-9a4ef8866b2a(cell1) {{(pid=117168) load_cells /opt/stack/nova/nova/context.py:464}} May 10 15:02:09.131664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:02:09.133235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:02:09.134047 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:02:09.136537 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:02:09.147167 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_db.sqlalchemy.engines [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.149426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_db.sqlalchemy.engines [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.151813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_db.sqlalchemy.engines [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.217148 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.context [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd26bc05-bc65-4702-9c6b-9a4ef8866b2a(cell1) {{(pid=117167) load_cells /opt/stack/nova/nova/context.py:464}} May 10 15:02:09.221559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:02:09.223167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:02:09.223981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:02:09.225914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:02:09.237216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_db.sqlalchemy.engines [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.239465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_db.sqlalchemy.engines [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.312038 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_db.sqlalchemy.engines [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.404471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_db.sqlalchemy.engines [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 15:02:09.638349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: WARNING keystonemiddleware.auth_token [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 15:02:09.645940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: WARNING keystonemiddleware.auth_token [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 15:02:09.733389 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: WARNING keystonemiddleware.auth_token [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 15:02:09.740943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: WARNING keystonemiddleware.auth_token [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 15:02:09.994760 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: WARNING keystonemiddleware.auth_token [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 15:02:10.001197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: WARNING keystonemiddleware.auth_token [None req-a64de0e2-a8cf-4ddf-bade-b95813a7c9b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 15:02:10.006589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e6a8b89c0 pid: 117168 (default app) May 10 15:02:10.086966 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: WARNING keystonemiddleware.auth_token [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 15:02:10.093753 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: WARNING keystonemiddleware.auth_token [None req-83cbccc5-cfec-40c4-959e-1be765405f89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 15:02:10.098982 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e6a8b89c0 pid: 117167 (default app) May 10 15:02:52.804027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-aa0d01d0-c496-4e16-8c69-b74dbd89895b tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Action: 'create', calling method: .version_select at 0x7f7de2b81280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-599883972", "metadata": {"Type": "work"}}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:02:54.550444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-aa0d01d0-c496-4e16-8c69-b74dbd89895b tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.927687 May 10 15:02:54.551458 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 1/1] 10.222.0.83 () {60 vars in 1155 bytes} [Tue May 10 15:02:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2930 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 15:02:55.265097 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-07b703ba-84d9-4258-a2d4-b384ec670907 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Calling method '.version_select at 0x7f7de2c0ef70>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:02:55.399409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-892425033", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "networks": [{"uuid": "550b358e-750e-4b62-abcd-d8a6d648131e"}]}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:02:55.647832 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] validate_networks() for [('550b358e-750e-4b62-abcd-d8a6d648131e', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:02:55.809268 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-07b703ba-84d9-4258-a2d4-b384ec670907 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4" status: 200 len: 353 microversion: 2.1 time: 1.247853 May 10 15:02:55.816648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 1/2] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:02:54 2022] GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4 => generated 353 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:02:55.828545 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a1a50a64-a499-4142-8b1b-66338234872d tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Calling method '.version_select at 0x7f7de2a43280>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:02:55.945694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a1a50a64-a499-4142-8b1b-66338234872d tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4" status: 200 len: 353 microversion: 2.1 time: 0.121496 May 10 15:02:55.947355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:02:55 2022] GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:02:55.959244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3cc96b87-3842-4579-be8b-b47d5094895f tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Calling method '.version_select at 0x7f7de2a43940>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:02:56.156634 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3cc96b87-3842-4579-be8b-b47d5094895f tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4" status: 202 len: 0 microversion: 2.1 time: 0.201593 May 10 15:02:56.157737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 3/4] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:02:55 2022] DELETE /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:02:56.167152 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-72b6d35c-7196-4627-abec-f5d7e4c79244 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Calling method '.version_select at 0x7f7de2a43b80>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:02:56.315715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-72b6d35c-7196-4627-abec-f5d7e4c79244 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4" status: 200 len: 352 microversion: 2.1 time: 0.154054 May 10 15:02:56.316669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 4/5] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:02:56 2022] GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4 => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:02:57.328484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f45a55b4-65bf-44af-b1dc-af60fd028e07 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Calling method '.version_select at 0x7f7de2a43430>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:02:57.387775 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-f45a55b4-65bf-44af-b1dc-af60fd028e07 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] HTTP exception thrown: Volume f3408b3e-2544-402d-bca8-f9c8a8a409a4 could not be found. May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f45a55b4-65bf-44af-b1dc-af60fd028e07 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Request method failure captured: May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4 HTTP/1.1 May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6bRD0A6kyTUgIfeKMEEQEjZA2y_h3OMUaK6z28iHWxNbaScVYdHmlSAjWZVKl3g_Wg_bM7aQQdSfFUjPf0fx1IaL9zWJgHBOkGkTIaPjg16cd_T9gI9q0VLk_whsvjrzlKgGiCK4vh7l3EB8AeIOqzl8t4rvxCsKJZH3KWH17gPew May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 8ec07df1f4694dbd98691ceb14809277 May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesGetTestJSON-735712176 May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:02:57.392242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8ec07df1f4694dbd98691ceb14809277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8ec07df1f4694dbd98691ceb14809277"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8ec07df1f4694dbd98691ceb14809277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8ec07df1f4694dbd98691ceb14809277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesGetTestJSON-735712176 May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 8ec07df1f4694dbd98691ceb14809277 May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesGetTestJSON-735712176 May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesGetTestJSON-735712176-project May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 12b3dbd4c078489db46a027b1e50c33d May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesGetTestJSON-735712176-project May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Volume f3408b3e-2544-402d-bca8-f9c8a8a409a4 could not be found. May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'f3408b3e-2544-402d-bca8-f9c8a8a409a4'} May 10 15:02:57.394027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3408b3e-2544-402d-bca8-f9c8a8a409a4 could not be found. (HTTP 404) (Request-ID: req-289465e9-c94f-4bcc-91d7-112197dd0868) May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:02:57.395117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:02:57.396602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3408b3e-2544-402d-bca8-f9c8a8a409a4 could not be found. May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 15:02:57.397956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3408b3e-2544-402d-bca8-f9c8a8a409a4 could not be found. May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3408b3e-2544-402d-bca8-f9c8a8a409a4 could not be found. May 10 15:02:57.400274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:02:57.406814 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f45a55b4-65bf-44af-b1dc-af60fd028e07 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] Returning 404 to user: Volume f3408b3e-2544-402d-bca8-f9c8a8a409a4 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:02:57.406814 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f45a55b4-65bf-44af-b1dc-af60fd028e07 tempest-VolumesGetTestJSON-735712176 tempest-VolumesGetTestJSON-735712176-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4" status: 404 len: 109 microversion: 2.1 time: 0.078728 May 10 15:02:57.407809 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 5/6] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:02:57 2022] GET /compute/v2.1/os-volumes/f3408b3e-2544-402d-bca8-f9c8a8a409a4 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:02:58.540121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:02:58.540677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:02:58.541016 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:02:58.541428 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:02:58.541880 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:02:58.581420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:02:58.582096 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:02:58.583129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:02:58.583708 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:02:58.697564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Getting quotas for project 28efa99d77e4438ab681323ffb37d41e. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:02:58.709381 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Getting quotas for user 80ced7317f0f4652a51bad39252805b2 and project 28efa99d77e4438ab681323ffb37d41e. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:02:58.746975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:02:58.761611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:02:59.025031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-231aa1b9-4e6a-4318-aafe-704fdb194a7a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.739184 May 10 15:02:59.025031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 2/7] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:02:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 15:02:59.036173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-fdc20961-449d-4011-ba5b-b0e48f9a0164 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:02:59.039046 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-fdc20961-449d-4011-ba5b-b0e48f9a0164 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:02:59.428954 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fdc20961-449d-4011-ba5b-b0e48f9a0164 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:02:59.454045 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-fdc20961-449d-4011-ba5b-b0e48f9a0164 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1214 microversion: 2.1 time: 0.422179 May 10 15:02:59.466594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 6/8] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:02:59 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1214 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:00.483297 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-390db37c-0b57-4df1-983e-caaebe4fe408 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:00.483921 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-390db37c-0b57-4df1-983e-caaebe4fe408 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:00.740642 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-390db37c-0b57-4df1-983e-caaebe4fe408 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:00.779413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-390db37c-0b57-4df1-983e-caaebe4fe408 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1214 microversion: 2.1 time: 0.299052 May 10 15:03:00.780666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 3/9] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:00 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:01.576708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1811276334", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:01.690038 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] validate_networks() for [('bb0f29c1-b758-46a7-96df-e2b922422879', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:03:01.797133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:01.798346 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:01.805717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:01.806586 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:01.810008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:01.810945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:02.020928 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:02.038163 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-891e2c11-9d8c-4a5e-a232-fe9a6bef6fb3 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1218 microversion: 2.1 time: 0.244651 May 10 15:03:02.041020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 4/10] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:01 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:03.059246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:03.060643 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:03.071029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:03.072597 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:03.073835 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:03.074579 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:03.185454 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:03.196048 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2a6928b9-4273-4904-8978-b5435faec2c8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1266 microversion: 2.1 time: 0.142452 May 10 15:03:03.208937 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 5/11] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:03 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:04.071174 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6c9f21aa-c2f2-455b-8aae-7ca8bf69c7a9 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de18271f0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:04.201110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:03:04.201669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:03:04.201669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:03:04.202476 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:03:04.202476 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:03:04.206815 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6c9f21aa-c2f2-455b-8aae-7ca8bf69c7a9 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/5452055c-444e-4f77-b070-66b541ff5cdd" status: 200 len: 350 microversion: 2.1 time: 0.152367 May 10 15:03:04.208203 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:03:04 2022] GET /compute/v2.1/os-volumes/5452055c-444e-4f77-b070-66b541ff5cdd => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:04.216500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:04.217488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:04.226481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:04.234657 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:04.235902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:04.238910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:04.250530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:04.253321 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:04.254866 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:04.257761 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:04.333950 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for project d851fe67b7e940f9b20979bdd619bf48. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:03:04.357374 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for user e690e810cdb54431af33651d13272239 and project d851fe67b7e940f9b20979bdd619bf48. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:03:04.387997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:03:04.399844 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:03:04.590579 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4e1a2d15-6260-4732-b29b-41dad3d9dbb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.213301 May 10 15:03:04.591706 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 7/13] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:03:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:03:04.603902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9c8ecfe1-9bf7-43f8-855b-d77a4a4cf218 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:04.610860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9c8ecfe1-9bf7-43f8-855b-d77a4a4cf218 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:05.086193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9c8ecfe1-9bf7-43f8-855b-d77a4a4cf218 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:05.101881 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9c8ecfe1-9bf7-43f8-855b-d77a4a4cf218 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1222 microversion: 2.1 time: 0.503178 May 10 15:03:05.104233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 8/14] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:04 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1222 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:05.131262 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:05.151411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d2064b4b-185c-481e-91a2-46d9ffb3a708 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1272 microversion: 2.1 time: 0.940444 May 10 15:03:05.158699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 7/15] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:04 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1272 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:05.416685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-467925950", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:05.591008 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] validate_networks() for [('bb0f29c1-b758-46a7-96df-e2b922422879', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:03:06.054544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7d98e10a-33f1-4861-9894-d933f603e360 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de188a430>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:06.207191 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7d98e10a-33f1-4861-9894-d933f603e360 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/31034e34-9e30-4425-8d85-86d138fb96a0" status: 200 len: 351 microversion: 2.1 time: 0.164655 May 10 15:03:06.208138 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 8/16] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:03:06 2022] GET /compute/v2.1/os-volumes/31034e34-9e30-4425-8d85-86d138fb96a0 => generated 351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:03:06.213084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:06.224840 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:06.234289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:06.243588 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:06.248540 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:06.250125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:06.708354 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:06.718639 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d9dbfa7a-579c-421e-883b-ebd8468c3c54 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1272 microversion: 2.1 time: 0.509240 May 10 15:03:06.720379 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 9/17] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:06 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1272 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:07.740041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:07.743733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:07.769623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:07.772284 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:07.773999 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:07.791502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:08.433906 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:03:08.434937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:03:08.435561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:03:08.436100 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:03:08.436668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:03:08.460942 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:08.462181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:08.463386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:08.463986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:08.525239 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for project d851fe67b7e940f9b20979bdd619bf48. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:03:08.539875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for user e690e810cdb54431af33651d13272239 and project d851fe67b7e940f9b20979bdd619bf48. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:03:08.572988 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:03:08.575199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:03:08.668345 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f1b06594-e912-4e6c-abd9-6b944eef8107 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.256473 May 10 15:03:08.669266 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 9/18] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:03:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 15:03:08.678199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b88366cc-e1f2-4627-95ee-851dbc379f0b tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de206fca0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:08.775603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b88366cc-e1f2-4627-95ee-851dbc379f0b tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/77748c05-944a-44a9-b8c6-1e9424235903" status: 200 len: 351 microversion: 2.1 time: 0.105143 May 10 15:03:08.776671 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 10/19] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:03:08 2022] GET /compute/v2.1/os-volumes/77748c05-944a-44a9-b8c6-1e9424235903 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:08.781532 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b0ebf4be-1af0-4fad-94a0-0d298c142b61 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:08.784686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b0ebf4be-1af0-4fad-94a0-0d298c142b61 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:09.461872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b0ebf4be-1af0-4fad-94a0-0d298c142b61 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:09.467570 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:09.470680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b0ebf4be-1af0-4fad-94a0-0d298c142b61 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1221 microversion: 2.1 time: 0.692701 May 10 15:03:09.483565 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-046a1be7-df47-4dd1-91b9-e82cb9ff3d57 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 1.748897 May 10 15:03:09.492787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 11/20] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:08 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1221 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:09.504891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 10/21] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:07 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:09.521572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f19b1950-6f64-481e-95bf-8b02a8e690d4 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de206fd30>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:09.878625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f19b1950-6f64-481e-95bf-8b02a8e690d4 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.383907 May 10 15:03:09.879212 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 12/22] 10.222.0.83 () {58 vars in 1133 bytes} [Tue May 10 15:03:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:09.891729 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-61d125e5-dbe6-43b2-80ae-fa837509de4d tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de188a430>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:10.150801 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-61d125e5-dbe6-43b2-80ae-fa837509de4d tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.262872 May 10 15:03:10.151949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 11/23] 10.222.0.83 () {58 vars in 1148 bytes} [Tue May 10 15:03:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:10.164458 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f71f3624-aa83-4499-aadc-0c94df7c85da tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de207e700>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:10.425790 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f71f3624-aa83-4499-aadc-0c94df7c85da tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.265194 May 10 15:03:10.426566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 13/24] 10.222.0.83 () {58 vars in 1133 bytes} [Tue May 10 15:03:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:10.438211 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f60d6f40-caef-4070-92be-1c4ea3bd93ee tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de1827820>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:10.493181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:10.496488 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:10.525578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:10.526041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:10.539031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:10.539553 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:10.747978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f60d6f40-caef-4070-92be-1c4ea3bd93ee tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.313506 May 10 15:03:10.748846 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 12/25] 10.222.0.83 () {58 vars in 1166 bytes} [Tue May 10 15:03:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:10.753466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:10.763267 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:10.791401 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:10.791873 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:10.792656 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:10.793099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:11.145605 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:11.201972 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a6df45a3-9674-4630-be74-cfaab0d8f827 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1217 microversion: 2.1 time: 0.712399 May 10 15:03:11.202518 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 14/26] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:10 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1217 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:11.212638 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-96318f1a-7664-427a-8622-cfcc0b6d57af tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de207e9d0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:11.426943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-96318f1a-7664-427a-8622-cfcc0b6d57af tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.223326 May 10 15:03:11.428174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 15/27] 10.222.0.83 () {58 vars in 1169 bytes} [Tue May 10 15:03:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:11.440415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8d665b85-2854-426f-adb5-59047dcaf563 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de1807e50>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:11.655924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8d665b85-2854-426f-adb5-59047dcaf563 tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.219245 May 10 15:03:11.657050 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 16/28] 10.222.0.83 () {58 vars in 1154 bytes} [Tue May 10 15:03:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:11.678629 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d604a876-1087-455b-9c11-b2bc85b1f16b tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de17f6820>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:11.979159 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d604a876-1087-455b-9c11-b2bc85b1f16b tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.311858 May 10 15:03:11.980586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 17/29] 10.222.0.83 () {58 vars in 1187 bytes} [Tue May 10 15:03:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:11.997015 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5dace428-4cb1-4386-b190-f1ca6bc7758b tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] Calling method '.version_select at 0x7f7de207e430>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:12.232017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5dace428-4cb1-4386-b190-f1ca6bc7758b tempest-VolumesTestJSON-181072783 tempest-VolumesTestJSON-181072783-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.240713 May 10 15:03:12.240590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 18/30] 10.222.0.83 () {58 vars in 1154 bytes} [Tue May 10 15:03:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:12.254813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:12.255539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:12.308690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:12.313482 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:12.314702 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:12.318009 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:12.531694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:12.543288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-257969ea-47f0-45cb-9b98-ac29e841f96b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1279 microversion: 2.1 time: 0.299228 May 10 15:03:12.555940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 19/31] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:12 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1279 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:12.791789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:12.804277 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ada8d43d-137c-454c-8b21-1ca73c3c7577 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 2.052195 May 10 15:03:12.804277 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 13/32] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:10 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:13.367356 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-109b2e7a-a89e-436a-ae3b-a542ccaea1ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: .version_select at 0x7f7de17f6af0>, body: {"keypair": {"name": "tempest-keypair-498207178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx0WOGmch2yu/A6fl6hSuo5Zth3/24husvCgVERLCX2YwWYgL7Fy6W6DHeXf/OybyPRcCi38Cgi0ITfO9vDcdG488hdLWaLak/VyC34a4U/wv+dPpvYmwNd5kHGi3v5Uw=="}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:13.416856 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-109b2e7a-a89e-436a-ae3b-a542ccaea1ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:03:13.434704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-109b2e7a-a89e-436a-ae3b-a542ccaea1ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:03:13.554872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-109b2e7a-a89e-436a-ae3b-a542ccaea1ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.568977 May 10 15:03:13.562606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 20/33] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:03:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:13.567334 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:13.568205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:13.588432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:13.589434 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:13.590515 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:13.591319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:13.823282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:13.824285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:13.860476 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:13.861098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:13.864073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:13.866978 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:14.377628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:14.391738 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bd8590da-8c7b-4b1c-a7d1-8b4ee970f2b0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1279 microversion: 2.1 time: 0.825925 May 10 15:03:14.392902 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 14/34] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:13 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1279 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:14.972674 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:14.983791 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ab87693b-d423-4d3a-9b0a-91082191f6f9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 1.166348 May 10 15:03:14.996681 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 21/35] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:13 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:15.414784 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:15.416214 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:15.443996 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:15.447343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:15.452649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:15.454482 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:15.831419 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:15.845102 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-88d0eb6c-806d-4b69-be08-ae513e258c8d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1279 microversion: 2.1 time: 0.437793 May 10 15:03:15.848889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 15/36] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:15 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1279 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:16.003112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:16.004287 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:16.018415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:16.025517 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:16.028322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:16.028824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:16.866219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:16.867544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:16.884705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:16.886290 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:16.888115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:16.894865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:17.231269 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:17.244462 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-aa264667-90e0-42fc-83c7-d7473a6eb9d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1279 microversion: 2.1 time: 0.382532 May 10 15:03:17.245477 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 16/37] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:16 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1279 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:17.435512 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-8cae857b-5312-46fd-af60-89fd78bfc0de req-3c8ff0f7-91bd-4b92-b8a7-6ebe2d3d5b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35516b72-f039-494f-8fe5-e54664cf4e24", "tag": "7c37d535-dd86-4f45-a0ca-da9dcfab396d"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:17.461175 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8cae857b-5312-46fd-af60-89fd78bfc0de req-3c8ff0f7-91bd-4b92-b8a7-6ebe2d3d5b49 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:17.463444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8cae857b-5312-46fd-af60-89fd78bfc0de req-3c8ff0f7-91bd-4b92-b8a7-6ebe2d3d5b49 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:17.538526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-8cae857b-5312-46fd-af60-89fd78bfc0de req-3c8ff0f7-91bd-4b92-b8a7-6ebe2d3d5b49 service nova] Creating event network-changed:7c37d535-dd86-4f45-a0ca-da9dcfab396d for instance 35516b72-f039-494f-8fe5-e54664cf4e24 on hv-cinder-83962 May 10 15:03:17.539202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8cae857b-5312-46fd-af60-89fd78bfc0de req-3c8ff0f7-91bd-4b92-b8a7-6ebe2d3d5b49 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 15:03:17.545439 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74274a31-6eec-47b1-b8c0-6d7c29eb8df1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:17.547125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74274a31-6eec-47b1-b8c0-6d7c29eb8df1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:17.548539 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74274a31-6eec-47b1-b8c0-6d7c29eb8df1 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:17.549578 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74274a31-6eec-47b1-b8c0-6d7c29eb8df1 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:17.558537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:17.569700 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d81cb6a2-251a-46f8-8231-bff2a7338d49 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 1.570502 May 10 15:03:17.576719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 22/38] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:15 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:17.590616 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.compute.rpcapi [None req-74274a31-6eec-47b1-b8c0-6d7c29eb8df1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 15:03:17.591923 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74274a31-6eec-47b1-b8c0-6d7c29eb8df1 None None] Releasing lock "compute-rpcapi-router" {{(pid=117168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 15:03:17.631116 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-74274a31-6eec-47b1-b8c0-6d7c29eb8df1 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.383637 May 10 15:03:17.633293 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 17/39] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:18.265226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:18.266209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:18.276077 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:18.277367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:18.278959 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:18.279621 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:18.595440 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:18.596341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:18.614347 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:18.614863 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:18.617600 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:18.621402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:19.389794 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:19.407997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8b4ae093-ceb7-4ff8-ae6d-8d867b5d7ebb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.817593 May 10 15:03:19.422438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 18/40] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:18 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:19.802778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:19.814074 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b83af497-53d6-4209-80ed-8737117cac4f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 1.553944 May 10 15:03:19.815673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 23/41] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:18 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:19.824136 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-ee3e7312-7c08-4ef4-9a1b-d4928bc056a8 req-6d38f7ef-02b9-4783-b00a-99796892c59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975ddad8-93eb-4cca-8d23-8de0f4637aea", "tag": "a75854b9-6524-4136-8cff-d2d61e26eec6"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:19.856603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-ee3e7312-7c08-4ef4-9a1b-d4928bc056a8 req-6d38f7ef-02b9-4783-b00a-99796892c59a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:19.857333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-ee3e7312-7c08-4ef4-9a1b-d4928bc056a8 req-6d38f7ef-02b9-4783-b00a-99796892c59a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:19.910761 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-ee3e7312-7c08-4ef4-9a1b-d4928bc056a8 req-6d38f7ef-02b9-4783-b00a-99796892c59a service nova] Creating event network-changed:a75854b9-6524-4136-8cff-d2d61e26eec6 for instance 975ddad8-93eb-4cca-8d23-8de0f4637aea on hv-cinder-83962 May 10 15:03:19.911328 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-ee3e7312-7c08-4ef4-9a1b-d4928bc056a8 req-6d38f7ef-02b9-4783-b00a-99796892c59a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 15:03:19.916656 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2b2a68d1-bb81-4c8b-9124-ac0982027dc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:19.917188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2b2a68d1-bb81-4c8b-9124-ac0982027dc2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:19.918280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2b2a68d1-bb81-4c8b-9124-ac0982027dc2 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:19.919986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2b2a68d1-bb81-4c8b-9124-ac0982027dc2 None None] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:19.944736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.compute.rpcapi [None req-2b2a68d1-bb81-4c8b-9124-ac0982027dc2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 15:03:19.946974 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2b2a68d1-bb81-4c8b-9124-ac0982027dc2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 15:03:19.985191 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a5778978-470a-4490-ab1b-2d4b10b927fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'create', calling method: .version_select at 0x7f7de17f45e0>, body: {"keypair": {"name": "tempest-keypair-1670522026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeXic+0WMzBrXoR0UstIQnHRwJ5KaiXvtKjjZYcWuwtRQZa5YLnCMYA2fjkAT4uP37BVPsObmh+3Hjs/Y6StM/0XSbgrmi4s14JbBGAXDIR6jSG04U5WD51ni1bsft7Q=="}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:19.991795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2b2a68d1-bb81-4c8b-9124-ac0982027dc2 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172315 May 10 15:03:19.993208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 24/42] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:20.046988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-a5778978-470a-4490-ab1b-2d4b10b927fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for project 09c6a716650343c18e62bbe7235e48c8. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:03:20.060006 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-a5778978-470a-4490-ab1b-2d4b10b927fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for user aa56c83ab8494901b85d00d4f592e5ce and project 09c6a716650343c18e62bbe7235e48c8. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:03:20.171427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a5778978-470a-4490-ab1b-2d4b10b927fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.413072 May 10 15:03:20.174482 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 19/43] 10.222.0.83 () {62 vars in 1199 bytes} [Tue May 10 15:03:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 417 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 15:03:20.428500 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:20.429457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:20.444526 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:20.444977 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:20.446599 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:20.447228 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:20.842094 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:20.843413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:20.859435 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:20.861349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:20.863149 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:20.865292 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:21.208907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:21.223172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bf0e0872-77bc-467f-ac95-ae27e5abd89b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.795401 May 10 15:03:21.223915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 25/44] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:20 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:21.677845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:21.716844 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-457194e5-e761-4d82-b18e-c9ef47d744e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.878184 May 10 15:03:21.719329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 20/45] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:20 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:22.241318 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:22.241949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:22.258924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:22.265850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:22.268069 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:22.269897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:22.734718 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:22.735346 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:22.758998 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:22.759815 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:22.762036 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:22.771186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:23.445516 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:23.462038 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:23.468725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-90179683-c1f6-4695-a459-4512575dc326 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.738792 May 10 15:03:23.481511 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 21/46] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:22 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:23.482572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c87a0748-375b-4696-91e2-2af63b196cad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 1.245210 May 10 15:03:23.483176 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 26/47] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:22 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:23.720346 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-d9c4d9b2-1ede-487d-b5bf-889751a5bede req-6bb7affe-dea3-40fe-8550-e589f5efea06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804e466b-083e-47d5-8597-ab3ed5d5dc72", "tag": "8d7f4ee8-d8cb-4edb-8b63-e09306e199a4"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:23.733275 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-d9c4d9b2-1ede-487d-b5bf-889751a5bede req-6bb7affe-dea3-40fe-8550-e589f5efea06 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:23.748766 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-d9c4d9b2-1ede-487d-b5bf-889751a5bede req-6bb7affe-dea3-40fe-8550-e589f5efea06 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:23.786031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-d9c4d9b2-1ede-487d-b5bf-889751a5bede req-6bb7affe-dea3-40fe-8550-e589f5efea06 service nova] Creating event network-changed:8d7f4ee8-d8cb-4edb-8b63-e09306e199a4 for instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 on hv-cinder-83962 May 10 15:03:23.802070 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-d9c4d9b2-1ede-487d-b5bf-889751a5bede req-6bb7affe-dea3-40fe-8550-e589f5efea06 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088644 May 10 15:03:23.805837 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 22/48] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:03:24.110069 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-755627406", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56419087-50d9-434c-b827-6ceec51e5c27"}], "security_groups": [{"name": "tempest-securitygroup--180779318"}], "key_name": "tempest-keypair-498207178", "user_data": "}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:24.301864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] validate_networks() for [('56419087-50d9-434c-b827-6ceec51e5c27', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:03:24.447758 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1393092550", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98f2117d-e406-4c1d-b8a0-22d70ac12c81"}], "security_groups": [{"name": "tempest-securitygroup--280386490"}], "key_name": "tempest-keypair-1670522026", "user_data": "}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:24.599257 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] validate_networks() for [('98f2117d-e406-4c1d-b8a0-22d70ac12c81', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:03:24.808442 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:03:24.808905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:03:24.809503 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:03:24.809919 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:03:24.810451 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:03:24.821161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:24.821629 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:24.822484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:24.822970 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:24.842110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:03:24.847245 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:03:24.865235 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:03:24.869093 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:03:24.920882 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b4540100-1e00-41f0-bc4f-80ebf6df4b10 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.814842 May 10 15:03:24.921869 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 27/49] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:03:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:03:24.927399 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:24.928213 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:24.935586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:24.936209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:24.937168 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:24.937761 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:25.130220 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:25.138789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1e594e95-9e52-4ccc-9672-5e5efc37e18f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.215593 May 10 15:03:25.139679 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 28/50] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:24 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:25.145360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:25.146236 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:25.153842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:25.154352 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:25.155219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:25.155669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:25.318040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:25.326621 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7c4d998d-ba9a-424b-bfa3-a8bf12c270a8 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.185560 May 10 15:03:25.327479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 29/51] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:25 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:25.332210 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8c410fdf-878f-4da9-a595-bbc5746b5126 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:25.332892 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8c410fdf-878f-4da9-a595-bbc5746b5126 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:25.392551 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8c410fdf-878f-4da9-a595-bbc5746b5126 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:25.400853 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8c410fdf-878f-4da9-a595-bbc5746b5126 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1240 microversion: 2.1 time: 0.072296 May 10 15:03:25.401513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 30/52] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:25 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:25.428364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:03:25.428800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:03:25.429250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:03:25.429660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:03:25.430162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:03:25.440410 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:25.440865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:25.441664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:25.442098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:25.460506 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for project 09c6a716650343c18e62bbe7235e48c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:03:25.467842 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for user aa56c83ab8494901b85d00d4f592e5ce and project 09c6a716650343c18e62bbe7235e48c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:03:25.482557 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:03:25.486184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:03:25.542042 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4ad59c06-3fc9-422f-a1cd-9a1c6ccbb98b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.100119 May 10 15:03:25.542766 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 23/53] 10.222.0.83 () {62 vars in 1187 bytes} [Tue May 10 15:03:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 15:03:25.552915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0533b51f-15f2-47bd-aae5-edfe937698a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:25.553722 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0533b51f-15f2-47bd-aae5-edfe937698a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:25.649615 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0533b51f-15f2-47bd-aae5-edfe937698a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:25.661794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0533b51f-15f2-47bd-aae5-edfe937698a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:25.663661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0533b51f-15f2-47bd-aae5-edfe937698a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:25.665163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0533b51f-15f2-47bd-aae5-edfe937698a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1282 microversion: 2.20 time: 0.116189 May 10 15:03:25.666123 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 31/54] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:25 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:03:26.166058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:26.171828 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:26.189061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.189530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.190343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.190864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.344784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:26.346036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:26.356624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.358243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.359459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.362114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.413033 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:26.427119 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4c355045-b030-42c6-ba03-bb282970dc0a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.272980 May 10 15:03:26.429741 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 24/55] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:26 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:26.438131 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:26.444746 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:26.457492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.458725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.459889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.460533 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.575503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:26.583852 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-074e8cb2-1d7c-4354-86e3-45a6349f159d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1292 microversion: 2.1 time: 0.149980 May 10 15:03:26.585200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 25/56] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:26 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1292 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:26.684285 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:26.685102 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:26.692089 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.693022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.694115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:26.694900 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:26.761141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:26.769565 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:26.771330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:26.772445 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3528cafc-df35-4c97-a11b-79b2e4b9880b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1334 microversion: 2.20 time: 0.092424 May 10 15:03:26.782149 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 26/57] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:26 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:03:26.831704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:26.839893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3b4f25af-23e3-41cc-9191-6a0e19568822 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.500098 May 10 15:03:26.840468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 32/58] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:26 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:27.446589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:27.447218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:27.453021 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.453467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.454219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.454674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.587398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:27.594603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-073606ab-9125-43ae-9b29-d37931d9624f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.152327 May 10 15:03:27.595176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 27/59] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:27 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:27.600789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:27.601403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:27.607930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.608376 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.609137 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.609570 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.670118 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:27.677368 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-64cf62d2-02e5-4ae4-b95f-efed921b14e5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1292 microversion: 2.1 time: 0.080343 May 10 15:03:27.678130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 33/60] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:27 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1292 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:27.793485 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:27.794021 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:27.799865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.800322 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.801076 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.801513 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.857005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:27.857625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:27.863915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.864135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:27.864379 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.865159 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:27.865848 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:27.873328 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:27.874898 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:27.876000 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6cddf0fe-24ac-41f5-bcf4-71fc52fa614a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1334 microversion: 2.20 time: 0.086975 May 10 15:03:27.876566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 28/61] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:27 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:27.996663 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:28.003861 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-838e1df9-20eb-4d1d-96bf-dac84bd1d818 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.150720 May 10 15:03:28.004656 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 34/62] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:27 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:28.612093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:28.612764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:28.619007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:28.619453 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:28.620207 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:28.620645 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:28.694942 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:28.695593 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:28.702008 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:28.702498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:28.703417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:28.703856 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:28.750205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:28.757521 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fc281549-3c50-4593-8cfb-6b4ce42fa059 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.149293 May 10 15:03:28.759101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 29/63] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:28 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:28.767349 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:28.774582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-42e88b0b-b69f-4e2a-86e4-b9d94a3e2f7e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1292 microversion: 2.1 time: 0.083533 May 10 15:03:28.775158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 35/64] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:28 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:28.892835 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:28.893472 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:28.899507 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:28.899957 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:28.900721 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:28.901160 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:28.963698 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:28.971954 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:28.973471 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:28.974605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a66eb7d6-db95-449c-a009-8bb7ab39b825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1334 microversion: 2.20 time: 0.085577 May 10 15:03:28.975169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 30/65] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:28 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:29.020001 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:29.020716 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:29.026632 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:29.027083 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:29.027875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:29.028312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:29.152815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:29.160033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0b6599ee-59eb-4370-8bfd-86921ba53e23 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.143854 May 10 15:03:29.160644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 36/66] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:29 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:29.775946 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:29.776496 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:29.782490 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:29.782953 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:29.783711 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:29.784145 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:29.796358 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:29.800441 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:29.814602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:29.815943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:29.816249 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:29.818920 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:29.924453 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:29.932772 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3fd0f238-6414-4aee-93a3-8ef1441e7976 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.161161 May 10 15:03:29.933677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 31/67] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:29 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:29.988132 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:29.996904 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-df8e9210-1649-4539-a5ca-5d37454d0e4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1300 microversion: 2.1 time: 0.208928 May 10 15:03:30.012260 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:30.012882 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:30.013721 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 37/68] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:29 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1300 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:30.019566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:30.020265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:30.021113 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:30.021742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:30.153200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:30.162372 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:30.164146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:30.165317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bf98ec2c-7f8d-4f55-be3f-de76f766f956 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1334 microversion: 2.20 time: 0.172531 May 10 15:03:30.165882 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 32/69] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:29 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1334 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:30.176962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:30.177584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:30.184245 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:30.184705 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:30.185485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:30.185928 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:30.323719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:30.331242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e36ad83e-b489-48af-b856-3b09df1eede5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.158178 May 10 15:03:30.332010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 38/70] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:30 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:30.948899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:30.949539 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:30.955280 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:30.955735 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:30.956500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:30.956940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:31.016700 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:31.017312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:31.023216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:31.024348 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:31.025117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:31.025603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:31.093726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:31.095595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:31.103005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-18711152-2091-429e-8ce8-93b81bae76d3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1310 microversion: 2.1 time: 0.090271 May 10 15:03:31.103587 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 39/71] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:31 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:31.103855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e9062f34-7348-4e19-bc63-3e1da51bc494 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.158748 May 10 15:03:31.104425 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 33/72] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:30 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:31.183274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:31.183921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:31.189830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:31.190281 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:31.191096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:31.191536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:31.251537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:31.259331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:31.260838 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:31.261927 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3df9f619-20c9-4b07-a898-58572823dd88 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1342 microversion: 2.20 time: 0.082557 May 10 15:03:31.262513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 40/73] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:31 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1342 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:31.347625 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:31.348243 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:31.354173 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:31.354661 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:31.355421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:31.355859 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:31.481624 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:31.488877 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c41fa653-4fca-45a8-82f7-fd9bc333b1eb tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.145136 May 10 15:03:31.489449 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 34/74] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:31 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:32.120489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:32.121255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:32.121614 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:32.121720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:32.127301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.127421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.127748 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.127841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.128502 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.128611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.128939 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.129101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.188762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:32.196109 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e6e4f94b-6ffc-4b03-8abd-b04a51117040 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1310 microversion: 2.1 time: 0.079941 May 10 15:03:32.196911 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 41/75] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:32 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:32.259155 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:32.266406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bb16fa4d-3637-4d86-8590-c526fc88e112 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.150265 May 10 15:03:32.266983 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 35/76] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:32 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:32.280154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:32.280800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:32.286680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.287134 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.287907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.288350 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.351225 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:32.359639 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:32.361150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:32.362250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-157f1950-1c55-4fdb-8e65-f7aa567cacf0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1342 microversion: 2.20 time: 0.085940 May 10 15:03:32.362879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 42/77] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:32 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:32.505555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:32.506100 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:32.512184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.512629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.513415 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:32.513845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:32.639016 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:32.646271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-155f24d7-2198-445b-9669-03f5a385d131 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.144532 May 10 15:03:32.646867 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 36/78] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:32 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:33.224265 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:33.225172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:33.239311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.254535 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.260550 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.262039 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.283491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:33.284744 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:33.296157 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.297156 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.300209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.300770 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.421471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:33.434002 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3314ecca-3cd5-48b0-9cd3-1f77d95cb389 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1298 microversion: 2.1 time: 0.221182 May 10 15:03:33.434834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 43/79] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:33 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1298 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:33.448093 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:33.448722 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:33.462962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.463425 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.464256 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.469133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.574728 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:33.585257 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:33.587122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:33.588543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9fe8e8e6-0e5a-4ffe-8207-473a99874699 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1340 microversion: 2.20 time: 0.149671 May 10 15:03:33.589219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 44/80] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:33 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:33.664907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:33.665530 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:33.672827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.673283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.674214 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:33.674846 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:33.686451 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:33.697790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0d58c657-13cb-4051-b6bd-1104b72d8cf3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.418266 May 10 15:03:33.700350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 37/81] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:33 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:34.090874 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:34.104818 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-75683723-0dc1-47c6-90de-aa64dc458bc2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.444216 May 10 15:03:34.106213 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 45/82] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:33 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:34.452614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:34.453227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:34.465215 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:34.468052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:34.469098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:34.472460 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:34.607078 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:34.608277 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:34.616677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:34.619831 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:34.621971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:34.624921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:34.751389 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:34.764372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:34.766111 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:34.768524 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e2619534-f584-4e90-aaa0-a3727acccee7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1340 microversion: 2.20 time: 0.164973 May 10 15:03:34.780280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 46/83] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:34 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:34.786555 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:34.787184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:34.794796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:34.795632 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:34.796639 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:34.797329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:35.070885 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:35.078415 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:35.092555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8ed8dbe1-d9de-4b9d-95e5-224cd04858c3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.644041 May 10 15:03:35.093684 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4fcb7b2c-0c0c-4cb7-8221-8f2ad3903150 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.312469 May 10 15:03:35.095899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 38/84] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:34 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:35.095980 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 47/85] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:34 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:35.125060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:35.125689 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:35.133060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:35.133820 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:35.134628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:35.135630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:35.448225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:35.458040 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5e12fb5b-5803-4e4a-aa46-711c073e4ee4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.337757 May 10 15:03:35.462866 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 39/86] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:35 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:35.788417 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:35.793530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:35.809345 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:35.810011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:35.810993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:35.812192 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:35.887471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-eadf01f4-c5e4-415b-bbfe-0888d6aecb6f req-44e4153a-0562-4e18-bd9c-bcd865ecc93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11828dfd-b035-4c1b-a5b7-61553717870c", "tag": "b3c1f55a-48b1-4225-af81-18e16729d371"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:35.895895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-eadf01f4-c5e4-415b-bbfe-0888d6aecb6f req-44e4153a-0562-4e18-bd9c-bcd865ecc93f service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:35.896425 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-eadf01f4-c5e4-415b-bbfe-0888d6aecb6f req-44e4153a-0562-4e18-bd9c-bcd865ecc93f service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:35.907877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-eadf01f4-c5e4-415b-bbfe-0888d6aecb6f req-44e4153a-0562-4e18-bd9c-bcd865ecc93f service nova] Creating event network-changed:b3c1f55a-48b1-4225-af81-18e16729d371 for instance 11828dfd-b035-4c1b-a5b7-61553717870c on hv-cinder-83962 May 10 15:03:35.917715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-eadf01f4-c5e4-415b-bbfe-0888d6aecb6f req-44e4153a-0562-4e18-bd9c-bcd865ecc93f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167203 May 10 15:03:35.922558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 48/87] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:36.007355 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:36.015783 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:36.017292 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:36.018428 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4f964af8-7537-4f15-ab20-9f910009187c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.235139 May 10 15:03:36.019003 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 40/88] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:35 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:36.112006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:36.112289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:36.113199 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:36.113468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:36.125855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:36.126322 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:36.128487 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:36.128932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:36.129705 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:36.130214 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:36.133796 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:36.134246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:36.301531 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:36.304418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:36.310320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7fcf890b-7cc3-4004-b890-f05e10afc462 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.202021 May 10 15:03:36.311054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 49/89] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:36 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:36.318547 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-43f02daf-969b-4f6e-9e06-8aa2863a2bd7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.205049 May 10 15:03:36.318547 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 41/90] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:36 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:36.475841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:36.476441 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:36.483133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:36.483575 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:36.484328 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:36.484761 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:36.616248 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:36.624259 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d425cfbd-190a-4ff6-8c57-67f49b8efb35 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.152180 May 10 15:03:36.624850 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 42/91] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:36 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:37.037041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:37.037561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:37.043632 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.044080 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.044837 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.045287 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.177933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:37.190767 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:37.192438 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:37.193649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9e664ed7-f570-4c5e-b1d9-880fbfcd1b26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.160500 May 10 15:03:37.194315 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 50/92] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:37 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:37.335943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:37.336565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:37.337481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:37.338253 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:37.348926 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.350924 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.352143 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.352761 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.353545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.353983 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.355045 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.355717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.518429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:37.531190 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e2acfb37-3896-4b57-814a-5e57b81eb86a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.208107 May 10 15:03:37.531944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 43/93] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:37 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:37.642373 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:37.643033 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:37.649585 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.650047 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.650846 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.651495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.705167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:37.713092 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-432303e5-0f0f-4bcc-9ad4-29203bc47650 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.385118 May 10 15:03:37.713770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 51/94] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:37 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:37.810930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-fc74f86b-485c-4c98-9df8-f73b437365c1 req-8fce583f-f011-467d-bee0-d112b7dcf09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975ddad8-93eb-4cca-8d23-8de0f4637aea", "name": "network-vif-plugged", "status": "completed", "tag": "a75854b9-6524-4136-8cff-d2d61e26eec6"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:37.826465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-fc74f86b-485c-4c98-9df8-f73b437365c1 req-8fce583f-f011-467d-bee0-d112b7dcf09d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:37.830878 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-fc74f86b-485c-4c98-9df8-f73b437365c1 req-8fce583f-f011-467d-bee0-d112b7dcf09d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:37.839157 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:37.852853 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-fc74f86b-485c-4c98-9df8-f73b437365c1 req-8fce583f-f011-467d-bee0-d112b7dcf09d service nova] Creating event network-vif-plugged:a75854b9-6524-4136-8cff-d2d61e26eec6 for instance 975ddad8-93eb-4cca-8d23-8de0f4637aea on hv-cinder-83962 May 10 15:03:37.855483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-833cffcf-379a-47ca-b19a-ac83d14afe76 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.217382 May 10 15:03:37.856706 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 44/95] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:37 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:37.859057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-fc74f86b-485c-4c98-9df8-f73b437365c1 req-8fce583f-f011-467d-bee0-d112b7dcf09d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129284 May 10 15:03:37.860032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 52/96] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:38.029051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-3665c7b5-1a96-4ed7-a0f9-83781a900a7a req-cc7d5f9d-934b-4775-91fd-c544e2731d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aac7eb-fbec-4d86-82c9-1237542ad61a", "tag": "c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:38.038750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-3665c7b5-1a96-4ed7-a0f9-83781a900a7a req-cc7d5f9d-934b-4775-91fd-c544e2731d5d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.039978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-3665c7b5-1a96-4ed7-a0f9-83781a900a7a req-cc7d5f9d-934b-4775-91fd-c544e2731d5d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.052816 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-3665c7b5-1a96-4ed7-a0f9-83781a900a7a req-cc7d5f9d-934b-4775-91fd-c544e2731d5d service nova] Creating event network-changed:c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7 for instance a4aac7eb-fbec-4d86-82c9-1237542ad61a on hv-cinder-83962 May 10 15:03:38.059236 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-3665c7b5-1a96-4ed7-a0f9-83781a900a7a req-cc7d5f9d-934b-4775-91fd-c544e2731d5d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034866 May 10 15:03:38.059937 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 45/97] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:38.213205 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:38.213900 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:38.220310 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.220794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.221547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.221992 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.376787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:38.385281 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:38.386846 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:38.387952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0145f846-efef-4337-a3a3-a7c721ed8a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.179165 May 10 15:03:38.388526 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 53/98] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:38 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:38.551000 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:38.552018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:38.565111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.566026 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.567082 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.567795 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.740586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:38.741212 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:38.757014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.757521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.758523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.759046 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.932111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:38.950936 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-96ccc9a4-8173-403c-a45b-9bd961fe0bd6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.404553 May 10 15:03:38.954964 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 46/99] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:38 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:38.961721 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:38.962481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:38.969894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.970689 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:38.971737 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:38.972276 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:39.044034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:39.065180 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-634ec532-21cd-4f8b-872a-8a62de6a7ed2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.328507 May 10 15:03:39.065783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 54/100] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:38 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:39.124471 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:39.132146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-20428af2-3855-4ad0-94f0-995447c33296 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.175525 May 10 15:03:39.132914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 47/101] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:38 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:39.405637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:39.406194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:39.412191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:39.412639 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:39.413389 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:39.413822 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:39.540660 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:39.548755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:39.550407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:39.551670 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6fa80f27-8fc6-419b-bb0a-bf84f6b8c3a4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.149902 May 10 15:03:39.552239 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 55/102] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:39 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:39.875960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-ae35e0b8-2bff-4dbb-bd7c-15ebeda46d5d req-0d1463a8-3985-464e-bb53-2daa1deb428e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35516b72-f039-494f-8fe5-e54664cf4e24", "name": "network-vif-plugged", "status": "completed", "tag": "7c37d535-dd86-4f45-a0ca-da9dcfab396d"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:39.884330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-ae35e0b8-2bff-4dbb-bd7c-15ebeda46d5d req-0d1463a8-3985-464e-bb53-2daa1deb428e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:39.884776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-ae35e0b8-2bff-4dbb-bd7c-15ebeda46d5d req-0d1463a8-3985-464e-bb53-2daa1deb428e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:39.895629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-ae35e0b8-2bff-4dbb-bd7c-15ebeda46d5d req-0d1463a8-3985-464e-bb53-2daa1deb428e service nova] Creating event network-vif-plugged:7c37d535-dd86-4f45-a0ca-da9dcfab396d for instance 35516b72-f039-494f-8fe5-e54664cf4e24 on hv-cinder-83962 May 10 15:03:39.901019 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-ae35e0b8-2bff-4dbb-bd7c-15ebeda46d5d req-0d1463a8-3985-464e-bb53-2daa1deb428e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028739 May 10 15:03:39.901649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 48/103] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:39.967503 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:39.968119 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:39.973862 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:39.974314 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:39.975119 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:39.975556 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:40.085207 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:40.087557 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:40.096811 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:40.098189 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:40.099955 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:40.100759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:40.120807 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:40.136745 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3b5378e5-118a-433e-8f22-fa634d186d78 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.172825 May 10 15:03:40.137339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 56/104] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:39 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:40.153950 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:40.154749 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:40.170645 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:40.171100 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:40.171885 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:40.172325 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:40.278313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:40.286341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-263b10ef-f100-4492-afd5-effd09711a96 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.207453 May 10 15:03:40.287493 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 49/105] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:40 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:40.326541 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:40.334448 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8eadcc97-8bc0-40df-b21b-25b20beaa936 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.188840 May 10 15:03:40.335646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 57/106] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:40 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:40.569372 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:40.569993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:40.575972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:40.576424 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:40.577192 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:40.577633 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:40.702061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:40.709813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:40.711854 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:40.712955 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cbc5bd99-35fc-4f66-a96b-ad802bcc67ca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.147505 May 10 15:03:40.713519 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 50/107] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:40 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:41.154688 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:41.155340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:41.161415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.161870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.162684 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.163126 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.286910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:41.294036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-05235274-853a-409d-bff7-509a8276db23 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.143157 May 10 15:03:41.294642 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 58/108] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:41 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:41.303828 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:41.304438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:41.310182 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.310665 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.311426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.311863 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.352776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:41.353387 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:41.359347 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.359933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.360703 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.361137 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.451487 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:41.458943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-591ad59d-4487-4998-a760-abbd7b623a53 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.158849 May 10 15:03:41.459818 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 51/109] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:41 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:41.494296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:41.501667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e2d67c72-5cc1-41b3-8653-ea7a323ff642 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.153162 May 10 15:03:41.502266 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 59/110] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:41 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:41.730991 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:41.731525 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:41.738124 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.738586 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.739553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:41.740070 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:41.871997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:41.879727 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:41.881314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:41.882462 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-25f245a5-096b-40ab-9ae0-34a6b11e804d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.155678 May 10 15:03:41.888829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 52/111] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:41 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:42.310646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:42.312993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:42.319785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.320283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:42.321532 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.322063 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:42.475094 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:42.476349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:42.477930 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:42.483020 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c79db589-adb0-4150-a750-01dde6a48c91 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.176367 May 10 15:03:42.483701 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 60/112] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:42 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:42.484626 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.485079 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:42.485878 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.486314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:42.518968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:42.519579 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:42.527358 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.527943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:42.528725 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.529362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:42.625307 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:42.633096 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-826d2246-6760-4474-98cb-7f84d4f3ccf1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.160556 May 10 15:03:42.633978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 53/113] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:42 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:42.662032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:42.670086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-426c6fe3-c0fe-4aea-b69c-261208e87614 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.154814 May 10 15:03:42.670694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 61/114] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:42 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:42.900757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:42.901363 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:42.907621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.908273 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:42.909044 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:42.909532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:43.047479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:43.055707 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:43.057234 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:43.058373 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-96c759c1-e660-4a1b-8f1f-94128388b398 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.162099 May 10 15:03:43.058965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 54/115] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:42 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:43.500435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:43.501037 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:43.506771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:43.507224 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:43.508499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:43.508938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:43.641677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:43.650056 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-44608a16-0961-48c4-bbad-43cf6cfcbdfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.153692 May 10 15:03:43.650673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 62/116] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:43 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:43.651120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:43.651799 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:43.657518 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:43.657962 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:43.658745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:43.659177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:43.686041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:43.686691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:43.692546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:43.693005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:43.693775 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:43.694221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:43.825895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:43.833775 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-dc2da1a6-1fc6-44a2-90d4-45b6c9507d6d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.151365 May 10 15:03:43.834372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 63/117] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:43 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:43.954065 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:43.961195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ed225246-4a80-4be3-a70c-e07e577e5415 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.314521 May 10 15:03:43.961747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 55/118] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:43 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:44.076252 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:44.076784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:44.082615 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.083064 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.083823 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.084267 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.207890 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:44.215835 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:44.217375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:44.218505 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-fbe15add-1fa4-4453-a703-8046de1c2f86 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.146227 May 10 15:03:44.219074 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 64/119] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:44 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:44.666582 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:44.667199 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:44.673213 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.673670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.674479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.674925 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.798238 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:44.806040 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-82134238-cd0e-4173-ab90-4358ce52cd01 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.143395 May 10 15:03:44.806658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 56/120] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:44 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:44.850178 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:44.850828 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:44.859116 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.860049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.860909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.861270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.978230 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:44.978933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:44.984730 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.985176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.985935 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:44.986365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:44.994277 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:45.001867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-df14b18a-bc66-47c4-9461-b19399a68526 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.155403 May 10 15:03:45.002486 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 65/121] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:44 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:45.113067 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:45.121277 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-12122f91-ae9a-4220-a18f-6dd85dfec615 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.147141 May 10 15:03:45.121855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 57/122] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:44 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:45.236844 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:45.237459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:45.243617 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:45.244067 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:45.244826 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:45.245264 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:45.368110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:45.376105 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:45.377605 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:45.378731 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-caff661f-8746-4452-a435-07b62b948878 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.145760 May 10 15:03:45.379320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 66/123] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:45 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:45.822974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-459f7f1d-aeab-4e5a-a8d7-2b324cd7ba2c req-109c909b-8801-4a15-83e8-f9f1a939888e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804e466b-083e-47d5-8597-ab3ed5d5dc72", "name": "network-vif-plugged", "status": "completed", "tag": "8d7f4ee8-d8cb-4edb-8b63-e09306e199a4"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:45.828319 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:45.829036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:45.839615 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:45.840071 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:45.840841 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:45.841278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:45.848704 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-459f7f1d-aeab-4e5a-a8d7-2b324cd7ba2c req-109c909b-8801-4a15-83e8-f9f1a939888e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:45.849147 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-459f7f1d-aeab-4e5a-a8d7-2b324cd7ba2c req-109c909b-8801-4a15-83e8-f9f1a939888e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:45.862333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-459f7f1d-aeab-4e5a-a8d7-2b324cd7ba2c req-109c909b-8801-4a15-83e8-f9f1a939888e service nova] Creating event network-vif-plugged:8d7f4ee8-d8cb-4edb-8b63-e09306e199a4 for instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 on hv-cinder-83962 May 10 15:03:45.867562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-459f7f1d-aeab-4e5a-a8d7-2b324cd7ba2c req-109c909b-8801-4a15-83e8-f9f1a939888e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048601 May 10 15:03:45.868161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 58/124] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:45.988361 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:46.001635 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9a506346-1007-4775-9fbe-7c95de2b100f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.176470 May 10 15:03:46.002248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 67/125] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:45 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:46.019888 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:46.020918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:46.035088 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:46.035811 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:46.037006 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:46.037640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:46.137520 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:46.138171 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:46.144212 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:46.144606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:46.145386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:46.145828 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:46.247383 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:46.254799 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0ae68568-3ec6-414b-8c4c-cb30a98fb5ad tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.239916 May 10 15:03:46.255564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 59/126] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:46 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:46.279972 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:46.287645 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f8c99f6d-ae0b-435a-9312-02c12d8898a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.154265 May 10 15:03:46.297483 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 68/127] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:46 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:46.396374 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:46.396924 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:46.403409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:46.403860 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:46.404619 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:46.405059 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:46.536514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:46.545362 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:46.547044 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:46.548240 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8b2370f4-ae61-444b-98b1-d4020d439120 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.155876 May 10 15:03:46.548778 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 60/128] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:46 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:47.018234 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:47.019017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:47.025017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.025461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.026275 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.026747 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.158242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:47.166112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bf7fa129-9be4-4118-bf5e-ea3641291a8f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.151084 May 10 15:03:47.166657 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 69/129] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:47 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:47.273065 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:47.273781 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:47.281930 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.282472 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.283428 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.283916 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.305758 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:47.306968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:47.313061 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.313872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.314747 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.315273 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.447806 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:47.462090 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-27be1ad7-ddba-45d8-8b7c-54a7ac314cb5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.192808 May 10 15:03:47.463425 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 61/130] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:47 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:47.472428 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:47.480732 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7fb84151-882d-4e64-befa-efdaa675b1ec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.178789 May 10 15:03:47.481309 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 70/131] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:47 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:47.566909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:47.567516 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:47.573188 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.573626 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.574408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:47.574833 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:47.701265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:47.709130 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:47.712733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:47.713850 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d8f76393-e181-44dc-bf31-466f84009761 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.150837 May 10 15:03:47.724277 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 62/132] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:47 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:48.184440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:48.185038 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:48.190681 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.191125 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.191888 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.192379 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.327544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:48.335735 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-249fbd64-c184-4a9c-a8e3-06b029511531 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.155666 May 10 15:03:48.336508 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 71/133] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:48 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:48.480145 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:48.480790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:48.486621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.487084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.487856 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.488297 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.497925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:48.498563 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:48.504650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.504958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.505728 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.506158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.640566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:48.647332 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:48.648207 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6752d09a-ebba-4209-9e69-58b7dc145229 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.172684 May 10 15:03:48.648791 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 63/134] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:48 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:48.655932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-588d8eb6-2b89-4521-ab5e-6049c05baad4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.162133 May 10 15:03:48.656598 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 72/135] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:48 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:48.732123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:48.732657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:48.738342 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.738831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.739591 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:48.740026 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:48.868808 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:48.877394 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:48.878935 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:48.880029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fb43b121-5507-4d50-966f-96d608855a22 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.152366 May 10 15:03:48.880598 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 64/136] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:48 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:49.354057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:49.354769 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:49.360914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.361383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:49.362160 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.362629 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:49.495472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:49.503288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-27feb9fa-f744-49bd-8bfb-41776a65dcb1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.154588 May 10 15:03:49.503859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 73/137] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:49 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:49.665221 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:49.665831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:49.671701 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.672146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:49.672885 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:49.673007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.673314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:49.673499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:49.680386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.680843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:49.682152 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.682707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:49.805408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:49.808776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:49.813109 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9b9c4d1c-5fad-4704-8809-1f0b968d6f37 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.151705 May 10 15:03:49.813687 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 65/138] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:49 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:49.816372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-27716b19-51a9-49bb-b228-b2b3f135ff95 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.147284 May 10 15:03:49.816937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 74/139] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:49 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:49.897464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:49.898063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:49.904371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.904813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:49.905558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:49.905987 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:50.031605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:50.039253 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:50.040741 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:50.041832 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-90e5f95c-59a5-42cb-bfd7-d8fe8ad3aeca tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.148105 May 10 15:03:50.042415 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 66/140] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:49 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:50.520981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:50.521691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:50.527576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:50.528096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:50.528953 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:50.529454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:50.662572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:50.669851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7b2e94db-c5fb-43a3-966e-7dbd00603f2e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.152734 May 10 15:03:50.670527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 75/141] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:50 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:50.829293 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:50.829907 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:50.832541 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:50.833156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:50.835988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:50.836437 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:50.837230 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:50.837760 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:50.838992 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:50.839447 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:50.840209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:50.840644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:50.967705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:50.975225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8d655f98-d207-42e9-927b-60013a7a10c7 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.150031 May 10 15:03:50.975807 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 67/142] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:50 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:50.979736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:50.986930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-030a94a2-a5d6-43b2-a5c3-6acbe9a66c9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.158165 May 10 15:03:50.987494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 76/143] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:50 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:51.060849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:51.061311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:51.067222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:51.067681 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:51.068447 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:51.068887 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:51.201285 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:51.209131 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:51.211069 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:51.213055 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-058c76c7-53ef-413d-ade3-cecea73639d3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.156630 May 10 15:03:51.213627 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 68/144] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:51 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:51.686099 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:51.686743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:51.692715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:51.693167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:51.693930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:51.694365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:51.816713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:51.824393 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ed78373c-a4ca-4a88-9f8b-2e6b06363939 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.142280 May 10 15:03:51.824968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 77/145] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:51 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:51.992346 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:51.992893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:51.999583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.000023 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.000810 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.001243 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.004119 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:52.004741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:52.011254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.011706 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.012473 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.012909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.127793 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:52.135751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-aea5c9b1-4460-4c33-ab76-a365a3e31ed2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.147231 May 10 15:03:52.136332 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 69/146] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:51 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:52.140972 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:52.148216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a1603e0a-135d-4a70-b50f-1ba81da027ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.148120 May 10 15:03:52.148780 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 78/147] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:51 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:52.231719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:52.232332 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:52.238132 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.238619 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.239383 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.239821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.363227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:52.371811 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:52.373420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:52.374612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d738dc5f-017b-40ce-bf7a-b6f0391d33dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.147185 May 10 15:03:52.375396 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 70/148] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:52 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:52.841380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:52.841985 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:52.847807 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.848255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.849000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:52.849428 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:52.972635 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:52.980332 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7b0e9b7c-e2be-4b94-a577-faa506736f74 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.143287 May 10 15:03:52.980903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 79/149] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:52 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:53.152122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:53.152736 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:53.158634 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:53.159089 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:53.159942 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:53.160383 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:53.164577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:53.165192 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:53.170968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:53.171367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:53.172133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:53.172572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:53.291212 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:53.298423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ddf6c819-a3f9-4388-8a7c-139e4bc002b9 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.150765 May 10 15:03:53.298988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 71/150] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:53 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:53.303994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:53.311352 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-449cafc3-a255-4abb-8bc4-97927cf9505c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.150661 May 10 15:03:53.311906 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 80/151] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:53 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:53.392142 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:53.392736 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:53.398639 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:53.399084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:53.399933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:53.400590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:53.522605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:53.530403 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:53.531969 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:53.533072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6f4a525d-7ef1-4256-bda9-6105c23e2e0b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.144839 May 10 15:03:53.533635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 72/152] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:53 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:53.997022 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:53.997641 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:54.003497 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.003948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.004711 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.005147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.161738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:54.171104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-63d9e543-28fe-4e9a-9d4b-1cc99ea21832 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.178695 May 10 15:03:54.180354 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 81/153] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:53 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:54.314858 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:54.315502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:54.321341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.321815 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.322617 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.323060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.327425 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:54.328040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:54.333789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.334175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.335023 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.335457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.457035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:54.465240 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e49d219f-aba6-4303-a545-fc89438bc204 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1314 microversion: 2.1 time: 0.154076 May 10 15:03:54.465765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:54.465928 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 73/154] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:54 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:54.473200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1016cf0f-073d-4373-99ad-37cf7a313231 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.149595 May 10 15:03:54.473771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 82/155] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:54 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:54.551960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:54.552690 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:54.559611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.560059 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.560854 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.561320 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.697392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:54.706195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:54.708942 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:54.708942 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bbaa5d1b-0db7-4f62-9dcb-f4d7cd3d2e33 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.161893 May 10 15:03:54.709385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 74/156] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:54 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:54.905877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-2530f338-e0ab-42e0-bfb7-8aa650ee1a3c req-e891d21c-e339-4191-9f1a-1cf149dba693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aac7eb-fbec-4d86-82c9-1237542ad61a", "name": "network-vif-plugged", "status": "completed", "tag": "c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:03:54.929290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-2530f338-e0ab-42e0-bfb7-8aa650ee1a3c req-e891d21c-e339-4191-9f1a-1cf149dba693 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:54.929917 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-2530f338-e0ab-42e0-bfb7-8aa650ee1a3c req-e891d21c-e339-4191-9f1a-1cf149dba693 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:54.942023 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-2530f338-e0ab-42e0-bfb7-8aa650ee1a3c req-e891d21c-e339-4191-9f1a-1cf149dba693 service nova] Creating event network-vif-plugged:c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7 for instance a4aac7eb-fbec-4d86-82c9-1237542ad61a on hv-cinder-83962 May 10 15:03:54.947820 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-2530f338-e0ab-42e0-bfb7-8aa650ee1a3c req-e891d21c-e339-4191-9f1a-1cf149dba693 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046198 May 10 15:03:54.948651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 83/157] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:03:55.187710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:55.188351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:55.194800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.195333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.196194 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.197328 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.328298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:55.335980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d096f599-7101-415b-931e-e25e41f20f3f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.152172 May 10 15:03:55.336554 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 75/158] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:55 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:55.482131 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:55.482854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:55.492742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:55.494020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:55.498509 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.499228 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.500073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.500505 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.500939 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.501046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.501708 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.502244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.668273 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:55.676134 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-756c9b8c-8b44-447d-8ff1-b6e372c13b8a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.186924 May 10 15:03:55.676873 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 76/159] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:55 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:55.681566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:55.689340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f9000b94-e667-4bd2-bf9a-43c22f2e5757 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1500 microversion: 2.1 time: 0.212115 May 10 15:03:55.689936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 84/160] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:55 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1500 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:55.731200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:55.731905 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:55.741122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.741580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.742364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:55.742847 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:55.904299 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:55.924658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:55.926759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:55.928187 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-10dce535-9d6d-4068-b6e6-508ce2666cf6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.202716 May 10 15:03:55.930052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 77/161] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:55 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:03:56.352842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:56.353475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:56.362718 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:56.363167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:56.363957 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:56.364389 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:56.693108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:56.693626 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:56.699907 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:56.700488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:56.701474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:56.702010 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:56.704146 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:56.713026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-12674700-194c-4ba0-821f-82eb13793d4c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.364014 May 10 15:03:56.713803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 85/162] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:56 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:56.876677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:56.894944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0ac6f0ca-6f92-4fb6-84bc-9dd1f8841e0c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.205791 May 10 15:03:56.895522 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 78/163] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:56 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:03:56.947646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:56.948182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:56.960305 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:56.960740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:56.961511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:56.961977 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:57.109411 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:57.117554 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:57.119827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:57.121351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-597e606a-71bc-438a-b8ae-a84ff398ba13 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.177809 May 10 15:03:57.122223 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 86/164] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:56 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:57.729444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:57.730027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:57.735792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:57.736238 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:57.736993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:57.737422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:57.914601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:57.917168 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:57.923210 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:57.927946 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:57.928794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:57.930573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:57.931597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:57.932767 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a4f20e9e-0ed2-4144-a1f0-94151a80cebd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.207582 May 10 15:03:57.933367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 79/165] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:57 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:58.116049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:58.123971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7bdfe1b0-e400-48b5-a39f-1c57058e68c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.214924 May 10 15:03:58.126781 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 87/166] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:57 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:58.139672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:58.140858 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:58.169271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:58.170949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:58.174283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:58.175764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:58.335033 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:58.347902 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:58.350495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:58.351877 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1756ee2c-ac28-4ca6-a029-17a4da558e73 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.216541 May 10 15:03:58.353049 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 80/167] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:58 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:03:58.951130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:58.951959 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:58.958296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:58.959208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:58.960426 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:58.960963 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:59.111891 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:59.120080 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ad5706a1-fcfe-4700-b5e3-c95e2a078d44 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.174661 May 10 15:03:59.120832 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 88/168] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:58 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:59.142036 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:59.142513 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:59.148200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:59.148859 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:59.149647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:59.150091 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:59.292307 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:59.299684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b6447a34-154b-4fe6-80e7-14b0f320666d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.161483 May 10 15:03:59.309746 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 81/169] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:03:59 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:03:59.370951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:03:59.371819 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:03:59.380796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:59.381254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:59.382036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:03:59.382504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:03:59.519773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:59.528320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:59.529859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:03:59.531026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-025166a8-6b9e-4815-ad77-04c864813b6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.164584 May 10 15:03:59.531772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 89/170] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:03:59 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:00.137409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:00.138009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:00.143809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.144397 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.144981 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.145408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.289488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:00.297464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-75907294-f474-487f-92c3-921b6b70dc12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.164381 May 10 15:04:00.298351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 82/171] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:00 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:00.316417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:00.317589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:00.325685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.326767 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.327636 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.328283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.406096 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-50b18c2b-88a8-4373-9347-a609b1bbc8e2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc134389-a857-42b0-b06f-9f9a131f97f0"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:00.408367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-50b18c2b-88a8-4373-9347-a609b1bbc8e2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:00.416756 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-50b18c2b-88a8-4373-9347-a609b1bbc8e2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.419699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-50b18c2b-88a8-4373-9347-a609b1bbc8e2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.421449 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-50b18c2b-88a8-4373-9347-a609b1bbc8e2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.421906 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-50b18c2b-88a8-4373-9347-a609b1bbc8e2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.516723 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:00.524132 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-fc6e632e-002a-4521-9ffb-785460d6069b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.211529 May 10 15:04:00.525793 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 90/172] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:00 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:00.550343 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:00.550894 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:00.558704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.559152 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.560129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:00.560568 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:00.732158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:00.740247 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:00.741778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:00.742954 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6fb2c868-ffdc-4bbf-839b-44679473dafc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.197711 May 10 15:04:00.744086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 91/173] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:00 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:01.315667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:01.316491 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:01.324120 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:01.325029 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:01.326177 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:01.326888 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:01.468824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:01.477235 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-178d9676-545e-43d2-889e-2d62017a6c41 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.165742 May 10 15:04:01.477860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 92/174] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:01 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:01.547595 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:01.548821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:01.557117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:01.557740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:01.558965 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:01.559549 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:01.731803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:01.751135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2a35c022-5033-4d12-be8a-a40686430bc7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1321 microversion: 2.1 time: 0.211401 May 10 15:04:01.751723 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 93/175] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:01 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:01.767355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:01.767969 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:01.774494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:01.774945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:01.775903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:01.776489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:01.934883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:01.943847 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:01.947249 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:01.949255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f9e34264-7158-4991-9b9e-5fb764778fd8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.185462 May 10 15:04:01.950298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 94/176] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:01 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:04:02.250483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-50b18c2b-88a8-4373-9347-a609b1bbc8e2 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "POST /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.848209 May 10 15:04:02.253993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 83/177] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:04:00 2022] POST /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24/os-volume_attachments => generated 194 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:02.494301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:02.494941 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:02.501284 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.501741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:02.502553 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.502992 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:02.654406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:02.661533 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3fda5cdf-1a83-481c-a8ee-0272c7e5b753 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.171454 May 10 15:04:02.672300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 95/178] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:02 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:02.773045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:02.773848 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:02.781461 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.781918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:02.782727 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.783169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:02.918146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:02.926114 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7c2e73a2-53e0-4e95-9cb7-29221164b2b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1514 microversion: 2.1 time: 0.158919 May 10 15:04:02.926976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 84/179] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:02 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:02.944004 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:02.945089 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:02.951715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.952409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-897f0a45-644f-4e6a-830d-11af3ccc285d req-225180fd-90f1-4775-86c3-b407b0836b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11828dfd-b035-4c1b-a5b7-61553717870c", "name": "network-vif-plugged", "status": "completed", "tag": "b3c1f55a-48b1-4225-af81-18e16729d371"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:02.952889 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:02.953873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.954922 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:02.964146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-897f0a45-644f-4e6a-830d-11af3ccc285d req-225180fd-90f1-4775-86c3-b407b0836b0a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.964549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-897f0a45-644f-4e6a-830d-11af3ccc285d req-225180fd-90f1-4775-86c3-b407b0836b0a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:02.978612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-897f0a45-644f-4e6a-830d-11af3ccc285d req-225180fd-90f1-4775-86c3-b407b0836b0a service nova] Creating event network-vif-plugged:b3c1f55a-48b1-4225-af81-18e16729d371 for instance 11828dfd-b035-4c1b-a5b7-61553717870c on hv-cinder-83962 May 10 15:04:02.984055 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-897f0a45-644f-4e6a-830d-11af3ccc285d req-225180fd-90f1-4775-86c3-b407b0836b0a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035766 May 10 15:04:02.984908 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 85/180] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:02.990893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:02.991917 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:02.999066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:02.999066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:03.000243 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:03.000800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:03.047475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lazy-loading 'flavor' on Instance uuid 804e466b-083e-47d5-8597-ab3ed5d5dc72 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:04:03.180308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:03.190514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:03.192439 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:03.193158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d11eeb13-5eec-46a7-8364-add6edba8b6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72/action" status: 200 len: 32 microversion: 2.1 time: 0.252994 May 10 15:04:03.193883 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-17e11c17-b999-4da4-b151-63f8e2f7e6da tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.207924 May 10 15:04:03.194496 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 86/181] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:02 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:03.199130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 96/182] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:04:02 2022] POST /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72/action => generated 32 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:04:03.204525 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:03.205145 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:03.211159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:03.211595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:03.212446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:03.212885 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:03.370190 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:03.380865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f6540bae-cb3a-483a-9a60-a71f5b8398a4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.180517 May 10 15:04:03.381456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 87/183] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:03 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:03.682360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:03.683114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:03.694576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:03.694576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:03.694576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:03.694576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:03.839888 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:03.850904 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-09b7618a-8030-41ad-9b84-e27b15ff569a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.174657 May 10 15:04:03.860809 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 97/184] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:03 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:04.212901 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:04.213505 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:04.219453 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:04.219916 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:04.220649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:04.221168 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:04.351007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:04.359319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:04.360404 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:04.361546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7e137207-592f-4781-9d3a-0e5f0cda308a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.152865 May 10 15:04:04.362130 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 88/185] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:04 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:04.397549 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:04.398162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:04.405005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:04.405185 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:04.405959 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:04.406424 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:04.550580 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:04.558987 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5ce17fa1-ef3c-4f9d-b4b0-dedf75792390 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.165198 May 10 15:04:04.559578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 98/186] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:04 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:04.869381 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:04.870002 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:04.876156 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:04.876605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:04.877364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:04.877802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:05.004913 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:05.012667 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-64061bd2-6c47-43dc-ac17-bb22ddfcedc6 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.147186 May 10 15:04:05.013250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 89/187] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:04 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:05.379700 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:05.380311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:05.387480 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:05.387932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:05.388695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:05.389134 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:05.583364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:05.584056 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:05.590890 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:05.591426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:05.592289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:05.592800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:05.666777 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:05.674997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:05.676514 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:05.677621 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-706b903e-32c2-4429-82e7-5bd4d9df1d62 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.301764 May 10 15:04:05.678193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 99/188] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:05 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:05.720676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:05.728475 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a385fb90-962f-4039-8777-9903fc08a959 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.149181 May 10 15:04:05.729042 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 90/189] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:05 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:06.028773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:06.029300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:06.035211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:06.035688 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:06.036442 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:06.036872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:06.163382 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:06.171081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-31adec1b-11c2-4f1a-bc47-a82f00935bca tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.146265 May 10 15:04:06.171644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 100/190] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:06 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:06.695789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:06.696880 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:06.703190 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:06.703633 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:06.704385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:06.704817 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:06.744914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:06.745531 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:06.751691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:06.752148 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:06.752920 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:06.753365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:06.831186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:06.840269 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:06.841901 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:06.843125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-37a1bcbf-0633-433c-8ea2-47fa92b2a855 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.151191 May 10 15:04:06.843922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 91/191] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:06 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:06.880815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:06.888572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-abeeadec-a89d-4266-8852-95155e3881f1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.147559 May 10 15:04:06.889136 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 101/192] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:06 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:07.187233 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:07.187843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:07.193696 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:07.194125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:07.194915 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:07.195354 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:07.318110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:07.325603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-09f67175-c8dc-45e4-8fb6-f3bb9aa425fd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.142176 May 10 15:04:07.326175 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 92/193] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:07 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:07.862873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:07.863490 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:07.870316 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:07.870805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:07.871838 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:07.872275 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:07.905093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:07.905725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:07.913235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:07.916628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:07.918036 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:07.918692 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:08.011770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:08.019694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:08.021204 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:08.022333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ed87cbee-85b7-4629-84cc-cfcdc39ba9e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1407 microversion: 2.20 time: 0.163422 May 10 15:04:08.022929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 102/194] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:07 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:08.066402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:08.074848 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a99ad57b-ed6b-45ff-98af-dd54fc617eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.173512 May 10 15:04:08.075531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 93/195] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:07 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:08.342300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:08.343060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:08.349559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:08.350044 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:08.350848 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:08.351285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:08.492254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:08.500007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e87511a6-7b68-4f4a-9fa3-9f225bbdd15c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.161546 May 10 15:04:08.500655 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 103/196] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:08 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:09.044961 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:09.046531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:09.054122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.054841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.055960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.056552 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.093237 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:09.093863 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:09.103054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.103915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.104716 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.105163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.345985 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:09.360881 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:09.363178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:09.365406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7937dd47-cb58-4ad0-820b-d176d953070b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1599 microversion: 2.20 time: 0.328103 May 10 15:04:09.366664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 94/197] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:04:09 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1599 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:04:09.386408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8413d95d-f647-4e44-87d4-2c9daadb4711 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:09.387553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8413d95d-f647-4e44-87d4-2c9daadb4711 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:09.393924 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8413d95d-f647-4e44-87d4-2c9daadb4711 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.394374 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8413d95d-f647-4e44-87d4-2c9daadb4711 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.395185 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8413d95d-f647-4e44-87d4-2c9daadb4711 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.395639 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8413d95d-f647-4e44-87d4-2c9daadb4711 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.425025 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:09.433007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-85b81989-f049-460f-a845-ba90c6708684 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.344386 May 10 15:04:09.442960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 104/198] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:09 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:09.516695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:09.517534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:09.525105 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.525691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.526868 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:09.527416 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:09.533615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8413d95d-f647-4e44-87d4-2c9daadb4711 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151559 May 10 15:04:09.540472 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 95/199] 10.222.0.83 () {60 vars in 1315 bytes} [Tue May 10 15:04:09 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 15:04:09.733159 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:09.746004 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d39e06af-d6bb-48e5-96d2-66d33360f8e2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.232905 May 10 15:04:09.758208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 105/200] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:09 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:10.456456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:10.457834 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:10.465602 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:10.466051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:10.466849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:10.467577 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:10.764594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:10.765958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:10.773986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:10.775115 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:10.776280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:10.776999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:10.938317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:10.951582 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1fa34aaa-49ae-424a-95d6-caffd937615b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.505784 May 10 15:04:10.952858 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 96/201] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:10 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:11.377260 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:11.386494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bd870b92-2761-4255-a134-221d5cb6a497 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1365 microversion: 2.1 time: 0.625470 May 10 15:04:11.387236 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 106/202] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:10 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1365 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:11.973097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:11.974779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:11.990126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:11.991601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:11.992893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:11.994748 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:12.315549 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-372e2631-0224-4ef2-914c-698a0bfd9620 req-aaf60dbe-356f-4ebb-9c9b-8e5f082c0cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aac7eb-fbec-4d86-82c9-1237542ad61a", "tag": "c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:12.330041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:12.336350 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-372e2631-0224-4ef2-914c-698a0bfd9620 req-aaf60dbe-356f-4ebb-9c9b-8e5f082c0cb8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:12.336843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-372e2631-0224-4ef2-914c-698a0bfd9620 req-aaf60dbe-356f-4ebb-9c9b-8e5f082c0cb8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:12.338220 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cba06090-ba86-4291-9540-8fe367bd750e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.369841 May 10 15:04:12.349599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 97/203] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:11 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:12.370856 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-372e2631-0224-4ef2-914c-698a0bfd9620 req-aaf60dbe-356f-4ebb-9c9b-8e5f082c0cb8 service nova] Creating event network-changed:c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7 for instance a4aac7eb-fbec-4d86-82c9-1237542ad61a on hv-cinder-83962 May 10 15:04:12.391828 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-372e2631-0224-4ef2-914c-698a0bfd9620 req-aaf60dbe-356f-4ebb-9c9b-8e5f082c0cb8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080215 May 10 15:04:12.392995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 107/204] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:12.403899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:12.404812 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:12.415869 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:12.417271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:12.418146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:12.418697 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:12.626747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:12.640866 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2db94728-51ec-4ec0-b8d4-642be3ff1f05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1552 microversion: 2.1 time: 0.240474 May 10 15:04:12.641728 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 98/205] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:12 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1552 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:12.658667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4cecaf06-ba9d-49c3-9e57-e31fd6e992b4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:12.659252 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4cecaf06-ba9d-49c3-9e57-e31fd6e992b4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:12.670660 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4cecaf06-ba9d-49c3-9e57-e31fd6e992b4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:12.671382 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4cecaf06-ba9d-49c3-9e57-e31fd6e992b4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:12.672330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4cecaf06-ba9d-49c3-9e57-e31fd6e992b4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:12.674255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4cecaf06-ba9d-49c3-9e57-e31fd6e992b4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:12.876048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4cecaf06-ba9d-49c3-9e57-e31fd6e992b4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221730 May 10 15:04:12.877043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 108/206] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:04:12 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:13.362320 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:13.364311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:13.403006 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:13.403485 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:13.404332 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:13.404782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:13.868668 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:13.877467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f67027f1-58d9-4ed1-ab33-c5a44df924d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.520700 May 10 15:04:13.878064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 99/207] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:13 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:14.683067 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-06a6650b-9704-4fd2-9135-70245788490a req-e843eb4f-a0b2-45af-a42e-cf666ba09fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11828dfd-b035-4c1b-a5b7-61553717870c", "tag": "b3c1f55a-48b1-4225-af81-18e16729d371"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:14.691373 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-06a6650b-9704-4fd2-9135-70245788490a req-e843eb4f-a0b2-45af-a42e-cf666ba09fb0 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:14.691939 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-06a6650b-9704-4fd2-9135-70245788490a req-e843eb4f-a0b2-45af-a42e-cf666ba09fb0 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:14.704076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-06a6650b-9704-4fd2-9135-70245788490a req-e843eb4f-a0b2-45af-a42e-cf666ba09fb0 service nova] Creating event network-changed:b3c1f55a-48b1-4225-af81-18e16729d371 for instance 11828dfd-b035-4c1b-a5b7-61553717870c on hv-cinder-83962 May 10 15:04:14.712026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-06a6650b-9704-4fd2-9135-70245788490a req-e843eb4f-a0b2-45af-a42e-cf666ba09fb0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033319 May 10 15:04:14.716570 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 109/208] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:14.895330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:14.896539 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:14.908641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:14.912133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:14.914849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:14.915483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:15.167583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:15.178634 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d287a926-9376-4cfe-a430-cf31d9d94eb7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.287543 May 10 15:04:15.192474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 100/209] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:14 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:16.200458 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:16.202150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:16.212148 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:16.212933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:16.214115 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:16.214869 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:16.443608 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:16.455883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b08ff9f4-a84c-4f1c-9828-6d7659bf5371 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.259958 May 10 15:04:16.458598 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 110/210] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:16 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:17.473014 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:17.474203 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:17.480504 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:17.480955 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:17.481718 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:17.482148 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:17.638110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:17.645718 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1a2e78ab-2ad0-4e7b-b7a9-7c1f191b17d5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.176521 May 10 15:04:17.646377 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 101/211] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:17 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:18.671149 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:18.672373 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:18.679085 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:18.679990 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:18.681649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:18.682278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:18.860267 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:18.872936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-fed9a69f-05c6-4768-aa18-1991856a85f7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.212950 May 10 15:04:18.874082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 111/212] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:18 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:19.632137 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:19.632646 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:19.643710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:19.644616 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:19.646144 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:19.646797 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:19.679693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:04:19.787700 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2e5a1c3f-9505-410c-9593-57eb056b819e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "DELETE /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 204 len: 0 microversion: 2.1 time: 0.159341 May 10 15:04:19.791869 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 102/213] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:04:19 2022] DELETE /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:04:19.800668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:19.801571 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:19.810160 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:19.810763 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:19.811621 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:19.812390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:19.892127 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:19.893184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:19.989694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:19.999673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-434be791-b9a2-4b3b-8898-3e4e8b2ce346 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1552 microversion: 2.1 time: 0.206081 May 10 15:04:20.000786 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 112/214] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:19 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:20.063621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:20.064095 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:20.064893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:20.065314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:20.210126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:20.218278 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8af72393-9951-4202-9be6-e1cdd5e72b8c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.331218 May 10 15:04:20.219054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 103/215] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:19 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:21.017423 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:21.018134 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:21.025991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:21.026562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:21.027273 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:21.027899 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:21.166167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:21.174364 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c44f45c3-35a9-436f-8ec9-378f9311b54c tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1552 microversion: 2.1 time: 0.161227 May 10 15:04:21.175056 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 113/216] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:21 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:21.235869 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:21.236486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:21.242798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:21.243254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:21.244028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:21.244469 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:21.388521 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:21.397626 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2d0ab237-c34a-4e59-9f6a-f4abdec839cd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.165656 May 10 15:04:21.398205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 104/217] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:21 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:22.191779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:22.192395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:22.198480 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:22.198938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:22.199706 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:22.200145 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:22.341761 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:22.349599 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0c00cc20-9766-40ac-8605-d8559a4304bd tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1552 microversion: 2.1 time: 0.161853 May 10 15:04:22.350487 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 114/218] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:22 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:22.415341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:22.416048 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:22.422692 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:22.423243 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:22.424118 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:22.424631 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:22.567751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:22.575661 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c30dc6d2-d643-4847-aa22-f863e5f2c6e5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.164313 May 10 15:04:22.576230 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 105/219] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:22 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:23.366301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:23.366951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:23.373430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:23.373872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:23.374660 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:23.375099 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:23.507897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:23.516244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-58315c47-3225-48de-bd27-7fef6ccc5168 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1552 microversion: 2.1 time: 0.153752 May 10 15:04:23.516815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 115/220] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:23 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:23.592347 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:23.592958 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:23.599263 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:23.599716 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:23.600485 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:23.600924 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:23.740050 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:23.754281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-79c2e592-fccc-4130-b21f-4bb73b04b9d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.165477 May 10 15:04:23.755912 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 106/221] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:23 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:24.532887 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:24.533503 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:24.539422 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:24.539876 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:24.540677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:24.541105 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:24.667326 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:24.675090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0a4effba-52f3-46c1-8a4d-db928e70cf0e tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1552 microversion: 2.1 time: 0.146039 May 10 15:04:24.675673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 116/222] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:24 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:24.771889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:24.772423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:24.779458 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:24.779946 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:24.780703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:24.781141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:24.908166 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:24.916125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c317da7f-a11a-4601-a4f8-ebf8cd94d4a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.148113 May 10 15:04:24.917010 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 107/223] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:24 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:25.691851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:25.692473 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:25.698420 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:25.698879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:25.699639 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:25.700076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:25.829220 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:25.837642 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a38d1b57-dae7-4043-813d-dcbb077bb448 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1552 microversion: 2.1 time: 0.149705 May 10 15:04:25.838565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 117/224] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:25 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:25.932920 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:25.933527 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:25.939798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:25.940238 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:25.940991 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:25.941451 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:26.072053 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:26.080151 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d10c24ef-1039-4f7d-8658-796240c82a4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.151072 May 10 15:04:26.080725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 108/225] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:25 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:26.854948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:26.855629 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:26.861509 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:26.861952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:26.862741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:26.863174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:27.010368 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:27.019316 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4b8bde8f-b9c2-409c-98ee-5770fd61bb7b tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1552 microversion: 2.1 time: 0.168463 May 10 15:04:27.020145 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 118/226] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:26 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:27.100370 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:27.100933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:27.108398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:27.108926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:27.109827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:27.110338 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:27.244479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:27.252204 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-336c76c5-761a-4ef5-a39a-f548d813de4b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.156011 May 10 15:04:27.252790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 109/227] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:27 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:28.037835 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:28.038671 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:28.045810 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:28.046448 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:28.047509 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:28.048238 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:28.158818 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:28.169565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4880e3c8-d9fd-4c3c-b7ef-ee7f5928bc0a tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1510 microversion: 2.1 time: 0.136380 May 10 15:04:28.170364 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 119/228] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:28 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1510 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:28.171325 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-9e646290-0171-4ad7-a831-b4ddfa2e4a82 req-3ea864cd-cf43-49ba-bb7c-56268127222a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35516b72-f039-494f-8fe5-e54664cf4e24", "name": "network-vif-deleted", "tag": "7c37d535-dd86-4f45-a0ca-da9dcfab396d"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:28.180634 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9e646290-0171-4ad7-a831-b4ddfa2e4a82 req-3ea864cd-cf43-49ba-bb7c-56268127222a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:28.181099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9e646290-0171-4ad7-a831-b4ddfa2e4a82 req-3ea864cd-cf43-49ba-bb7c-56268127222a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:28.193391 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-9e646290-0171-4ad7-a831-b4ddfa2e4a82 req-3ea864cd-cf43-49ba-bb7c-56268127222a service nova] Creating event network-vif-deleted:7c37d535-dd86-4f45-a0ca-da9dcfab396d for instance 35516b72-f039-494f-8fe5-e54664cf4e24 on hv-cinder-83962 May 10 15:04:28.199697 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-9e646290-0171-4ad7-a831-b4ddfa2e4a82 req-3ea864cd-cf43-49ba-bb7c-56268127222a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 May 10 15:04:28.203502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 110/229] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:04:28.268999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:28.269536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:28.275634 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:28.276082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:28.276841 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:28.277274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:28.410152 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:28.417883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d0a20fe9-97b1-40d3-880d-fe374e177490 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.152910 May 10 15:04:28.418479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 120/230] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:28 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:29.187820 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:29.188618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:29.194851 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:29.195385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:29.197146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:29.197743 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:29.233611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:29.234215 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:29.234712 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lazy-loading 'fault' on Instance uuid 35516b72-f039-494f-8fe5-e54664cf4e24 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:04:29.280276 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ced7317f0f4652a51bad39252805b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28efa99d77e4438ab681323ffb37d41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:29.288711 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8928fa0d-e3cc-46d9-b7d4-36d2d75c1e5d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 200 len: 1350 microversion: 2.1 time: 0.105663 May 10 15:04:29.289974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 111/231] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:29 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:29.434099 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:29.434767 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:29.440638 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:29.441084 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:29.441843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:29.442276 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:29.587156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:29.596061 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0d584a36-8668-45a8-8e7f-f123f0a469b9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.165811 May 10 15:04:29.596781 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 121/232] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:29 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:30.307106 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:30.307727 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:30.314219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:30.314733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:30.316177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:30.316630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:30.337349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] HTTP exception thrown: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Request method failure captured: May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 HTTP/1.1 May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6fuudUkc3D6ubXkEhQfe-exhxXKG6EagYoJMIc2fZFvIuXel0mWRw4BxHIku_qrnPQX7BZeLq1Hm8iYnXl9C9UIU3uBpks896bgwc-lR1zedgl6Zq1O_akgqcSG9x3DHQeYztef4Xa-s35ptEDMA2HXMXagMjYjGdrguR78U78vO8 May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:04:30.343218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 80ced7317f0f4652a51bad39252805b2 May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.344679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '35516b72-f039-494f-8fe5-e54664cf4e24'} May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:30.345509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.346914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:30.348800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Returning 404 to user: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:30.349672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bf146a21-4ad7-485b-95e2-5e4e3a4073e5 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 404 len: 111 microversion: 2.1 time: 0.047107 May 10 15:04:30.350243 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 112/233] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:30 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:04:30.463293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:30.464226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:30.470047 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:30.470543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:30.471482 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:30.471924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:30.485435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] HTTP exception thrown: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Request method failure captured: May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24/os-volume_attachments HTTP/1.1 May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6fuudUkc3D6ubXkEhQfe-exhxXKG6EagYoJMIc2fZFvIuXel0mWRw4BxHIku_qrnPQX7BZeLq1Hm8iYnXl9C9UIU3uBpks896bgwc-lR1zedgl6Zq1O_akgqcSG9x3DHQeYztef4Xa-s35ptEDMA2HXMXagMjYjGdrguR78U78vO8 May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:04:30.492112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 80ced7317f0f4652a51bad39252805b2 May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.493329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'server_id': '35516b72-f039-494f-8fe5-e54664cf4e24'} May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:30.494250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:30.495362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:30.496677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Returning 404 to user: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:30.496677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1aa068bf-2014-4a4e-9083-50eed8111eb4 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034906 May 10 15:04:30.496677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 122/234] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:04:30 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:04:30.616505 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:30.617637 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:30.626483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:30.627344 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:30.628335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:30.629094 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:30.785209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:30.793204 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c32bfcb7-c0c9-41d9-acb4-bec92a0778f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.182094 May 10 15:04:30.793791 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 113/235] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:30 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:31.739583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:31.741225 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:31.748419 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:31.749221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:31.750305 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:31.750837 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:31.767893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] HTTP exception thrown: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Request method failure captured: May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: DELETE /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 HTTP/1.1 May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6fuudUkc3D6ubXkEhQfe-exhxXKG6EagYoJMIc2fZFvIuXel0mWRw4BxHIku_qrnPQX7BZeLq1Hm8iYnXl9C9UIU3uBpks896bgwc-lR1zedgl6Zq1O_akgqcSG9x3DHQeYztef4Xa-s35ptEDMA2HXMXagMjYjGdrguR78U78vO8 May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:04:31.779154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 80ced7317f0f4652a51bad39252805b2 May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.780687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '35516b72-f039-494f-8fe5-e54664cf4e24'} May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:31.781583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.783896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:31.787973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Returning 404 to user: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:31.789221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-86edda33-fd0a-4956-83ac-2c2c93bbfc7d tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "DELETE /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 404 len: 111 microversion: 2.1 time: 0.054646 May 10 15:04:31.791165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 123/236] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:04:31 2022] DELETE /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:04:31.801331 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:31.801331 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] [instance: 35516b72-f039-494f-8fe5-e54664cf4e24] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:31.807323 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:31.807776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:31.808546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:31.808977 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:31.809741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:31.810459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:31.818668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:31.819199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:31.819998 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:31.820468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:31.824875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] HTTP exception thrown: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Request method failure captured: May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 HTTP/1.1 May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6fuudUkc3D6ubXkEhQfe-exhxXKG6EagYoJMIc2fZFvIuXel0mWRw4BxHIku_qrnPQX7BZeLq1Hm8iYnXl9C9UIU3uBpks896bgwc-lR1zedgl6Zq1O_akgqcSG9x3DHQeYztef4Xa-s35ptEDMA2HXMXagMjYjGdrguR78U78vO8 May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:04:31.826926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/28efa99d77e4438ab681323ffb37d41e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 28efa99d77e4438ab681323ffb37d41e May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904157049 May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 80ced7317f0f4652a51bad39252805b2 May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-DeleteServersTestJSON-1904157049-project May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.828120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '35516b72-f039-494f-8fe5-e54664cf4e24'} May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:31.828779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. May 10 15:04:31.830117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:04:31.832489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] Returning 404 to user: Instance 35516b72-f039-494f-8fe5-e54664cf4e24 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:31.833513 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-05a4835d-cbf4-42e0-9942-c4196ad6d795 tempest-DeleteServersTestJSON-1904157049 tempest-DeleteServersTestJSON-1904157049-project] 10.222.0.83 "GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24" status: 404 len: 111 microversion: 2.1 time: 0.038134 May 10 15:04:31.834814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 114/237] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:31 2022] GET /compute/v2.1/servers/35516b72-f039-494f-8fe5-e54664cf4e24 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:04:32.053458 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:32.068299 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f7c7388c-8b61-41ab-b3fa-67f84d22ecbe tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.263283 May 10 15:04:32.069090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 124/238] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:31 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:33.088171 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:33.092731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:33.103245 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:33.103791 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:33.104741 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:33.105568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:33.278299 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:33.286029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d46b0173-712d-4b78-ae04-01b9b13f090c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.204256 May 10 15:04:33.286614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 115/239] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:33 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:34.267246 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0930730a-2172-4a9d-9d42-2db188289b0a tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Action: 'create', calling method: .version_select at 0x7f7de0d7edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1120543031"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:34.302988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:34.303667 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:34.321768 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:34.323573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:34.326965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:34.327479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:34.572099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:34.580399 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a912a25d-74c7-4aef-8ccc-95fd28d6a06e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.281377 May 10 15:04:34.581368 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 116/240] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:34 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:34.712672 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0930730a-2172-4a9d-9d42-2db188289b0a tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.729814 May 10 15:04:34.714479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 125/241] 10.222.0.83 () {60 vars in 1154 bytes} [Tue May 10 15:04:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 732 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 15:04:34.725449 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-81fbb9c0-ac4a-47a1-96b3-065d32b20519 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d700d0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:34.803421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-81fbb9c0-ac4a-47a1-96b3-065d32b20519 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e" status: 200 len: 345 microversion: 2.1 time: 0.082213 May 10 15:04:34.804373 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 117/242] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:04:34 2022] GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:35.598846 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:35.600199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:35.607502 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:35.607964 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:35.608753 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:35.609195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:35.757208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:35.767603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-83805f6e-af4d-44ab-8209-1665b9d4404c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.173255 May 10 15:04:35.768295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 126/243] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:35 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:35.816931 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-06d7b7e5-bb62-4af3-afc9-767e868bed0c tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d79af0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:35.872479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-06d7b7e5-bb62-4af3-afc9-767e868bed0c tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e" status: 200 len: 346 microversion: 2.1 time: 0.059878 May 10 15:04:35.873279 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 118/244] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:04:35 2022] GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:35.884181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d61e2f43-1841-4fde-945c-52140fa00cba tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Action: 'create', calling method: .version_select at 0x7f7de0d66f70>, body: {"snapshot": {"volume_id": "de01a9c3-c4f1-40b6-af5b-2bf29124b10e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1574867168"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:36.061168 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d61e2f43-1841-4fde-945c-52140fa00cba tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.180761 May 10 15:04:36.061771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 127/245] 10.222.0.83 () {60 vars in 1161 bytes} [Tue May 10 15:04:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:36.072183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9121a8a2-c4e9-4720-b2f9-167d8158dfe9 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d57af0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:36.109474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9121a8a2-c4e9-4720-b2f9-167d8158dfe9 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 287 microversion: 2.1 time: 0.041643 May 10 15:04:36.110043 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 119/246] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:36 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:36.123897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4614e5d0-fb9e-4dd2-92ff-b15f51413c7c tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d7e3a0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:36.159005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4614e5d0-fb9e-4dd2-92ff-b15f51413c7c tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.042241 May 10 15:04:36.159567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 128/247] 10.222.0.83 () {58 vars in 1139 bytes} [Tue May 10 15:04:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:36.170424 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ed51e945-49a1-4019-9161-c820abd2ef68 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d57a60>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:36.200437 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ed51e945-49a1-4019-9161-c820abd2ef68 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 287 microversion: 2.1 time: 0.033808 May 10 15:04:36.201027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 120/248] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:36 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:36.786026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:36.787108 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:36.797607 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:36.798171 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:36.799087 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:36.800258 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:36.965429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:36.972946 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4053fb77-233f-4dfe-b878-a12580490c45 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.191389 May 10 15:04:36.973571 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 129/249] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:36 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:37.212466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b1fb0b5b-0945-4788-9144-ddfb8f86d4b1 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d709d0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:37.242080 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b1fb0b5b-0945-4788-9144-ddfb8f86d4b1 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 287 microversion: 2.1 time: 0.033805 May 10 15:04:37.243441 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 121/250] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:37 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:37.991154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:37.991826 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:37.998020 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:37.998496 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:37.999267 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:37.999705 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:38.122009 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:38.129303 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-00f4cd4c-0dd2-4a90-bee8-74c0e8e5a828 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.141917 May 10 15:04:38.129881 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 130/251] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:37 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:38.254888 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1ab9842d-09e2-4bd7-a4f2-b35fadd3538e tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0f54430>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:38.284020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1ab9842d-09e2-4bd7-a4f2-b35fadd3538e tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 287 microversion: 2.1 time: 0.033362 May 10 15:04:38.284601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 122/252] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:38 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:39.146312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:39.146965 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:39.153347 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:39.153815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:39.154596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:39.155031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:39.280007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:39.287197 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-637dc6c0-436f-4d25-88af-a4071485f1f8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.144796 May 10 15:04:39.287765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 131/253] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:39 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:39.296331 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-09bd399f-fed5-4a7e-a167-7e6843d4723a tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d70040>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:39.323975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-09bd399f-fed5-4a7e-a167-7e6843d4723a tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 287 microversion: 2.1 time: 0.031803 May 10 15:04:39.324524 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 123/254] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:39 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:40.304446 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:40.305057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:40.310804 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:40.311260 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:40.312042 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:40.312484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:40.336891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-dcfb221d-f815-46bf-91c9-62117c4bcc86 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d57820>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:40.365150 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-dcfb221d-f815-46bf-91c9-62117c4bcc86 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 287 microversion: 2.1 time: 0.032793 May 10 15:04:40.365712 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 124/255] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:40 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:04:40.439066 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:40.446955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a5a1c89e-3fae-41cc-ac57-06beb7b9dee5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.146359 May 10 15:04:40.447475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 132/256] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:40 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:41.170137 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1449147527", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:41.377159 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-88554594-75ba-4200-847b-90da42c58924 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d7ef70>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:41.407424 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-88554594-75ba-4200-847b-90da42c58924 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 288 microversion: 2.1 time: 0.034026 May 10 15:04:41.408005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 133/257] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:41 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:04:41.418197 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-40e84811-6f01-4468-bc0b-504062b91b1c tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d66dc0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:41.472993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-40e84811-6f01-4468-bc0b-504062b91b1c tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 202 len: 0 microversion: 2.1 time: 0.058843 May 10 15:04:41.477329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 134/258] 10.222.0.83 () {58 vars in 1253 bytes} [Tue May 10 15:04:41 2022] DELETE /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 15:04:41.478891 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:41.479497 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:41.486290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:41.486774 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:41.487546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:41.487986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:41.624554 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:41.632485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0f69d046-5790-4b69-a43c-6c6678692890 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.157833 May 10 15:04:41.633033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 135/259] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:41 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:41.637826 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ab388248-714d-48fd-875c-73eac9aaeae6 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d66820>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:41.668619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ab388248-714d-48fd-875c-73eac9aaeae6 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 200 len: 287 microversion: 2.1 time: 0.034344 May 10 15:04:41.669216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 136/260] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:41 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:42.648901 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:42.649576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:42.655390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:42.655838 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:42.656589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:42.657022 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:42.795511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:42.804182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-55620cfe-8893-4d24-ab77-5b68134500f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.159103 May 10 15:04:42.805500 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 137/261] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:42 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:42.810124 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4e5e71ae-c113-4f28-8844-cac7c305d219 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0ecd430>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:42.834088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-4e5e71ae-c113-4f28-8844-cac7c305d219 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] HTTP exception thrown: Snapshot a96fd794-f3dc-4132-8e54-c8a7895ea8de could not be found. May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4e5e71ae-c113-4f28-8844-cac7c305d219 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Request method failure captured: May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de HTTP/1.1 May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien8BDi_-plS-5RFdv1lU19sIql_XujhQsd0DvkLwU9lT7U6C6zpq-d6oA_-HVl8dGJG2a1GZeYkSCFZv3I0Vq40YlYmfU4CNQ3F-7s05ymYHnFeWrDRyPkn8LaCJC-Wb6nNxo8oFxVIxwZ5UolxZevu0k-0BEM6m1hvZmwG5kJCsBfQ May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:04:42.836339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2bb3fc11d50c4862a1cd85a67235333e May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Snapshot a96fd794-f3dc-4132-8e54-c8a7895ea8de could not be found. May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'a96fd794-f3dc-4132-8e54-c8a7895ea8de'} May 10 15:04:42.837779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a96fd794-f3dc-4132-8e54-c8a7895ea8de could not be found. (HTTP 404) (Request-ID: req-a3e8875a-bae8-4ee2-9b81-8b8d7dd59b2c) May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:42.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:04:42.842879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a96fd794-f3dc-4132-8e54-c8a7895ea8de could not be found. May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 15:04:42.844199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a96fd794-f3dc-4132-8e54-c8a7895ea8de could not be found. May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a96fd794-f3dc-4132-8e54-c8a7895ea8de could not be found. May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4e5e71ae-c113-4f28-8844-cac7c305d219 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Returning 404 to user: Snapshot a96fd794-f3dc-4132-8e54-c8a7895ea8de could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:42.845544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4e5e71ae-c113-4f28-8844-cac7c305d219 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de" status: 404 len: 111 microversion: 2.1 time: 0.031256 May 10 15:04:42.846477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 138/262] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:04:42 2022] GET /compute/v2.1/os-snapshots/a96fd794-f3dc-4132-8e54-c8a7895ea8de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:04:42.846477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1b8914f0-ce94-4437-a6d7-19eb8300d4f4 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d7ac10>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:42.909030 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1b8914f0-ce94-4437-a6d7-19eb8300d4f4 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e" status: 202 len: 0 microversion: 2.1 time: 0.066450 May 10 15:04:42.909738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 139/263] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:04:42 2022] DELETE /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:04:42.918750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-31c781bf-747c-444e-87fc-b552c9e7e528 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d7e160>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:42.963762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-31c781bf-747c-444e-87fc-b552c9e7e528 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e" status: 200 len: 345 microversion: 2.1 time: 0.049603 May 10 15:04:42.964345 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 140/264] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:04:42 2022] GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:04:43.821457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:43.831396 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:43.839932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:43.840465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:43.841333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:43.841773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:43.985969 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:43.993852 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0e3541fb-7c05-4c34-b252-0fdbd44e1b20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.176783 May 10 15:04:43.994449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 141/265] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:43 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:43.999053 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3d6e1f08-9173-42b5-88ad-36b7ffec4311 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d66b80>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:44.026464 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-3d6e1f08-9173-42b5-88ad-36b7ffec4311 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] HTTP exception thrown: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3d6e1f08-9173-42b5-88ad-36b7ffec4311 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Request method failure captured: May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e HTTP/1.1 May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien8BDi_-plS-5RFdv1lU19sIql_XujhQsd0DvkLwU9lT7U6C6zpq-d6oA_-HVl8dGJG2a1GZeYkSCFZv3I0Vq40YlYmfU4CNQ3F-7s05ymYHnFeWrDRyPkn8LaCJC-Wb6nNxo8oFxVIxwZ5UolxZevu0k-0BEM6m1hvZmwG5kJCsBfQ May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:04:44.028463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2bb3fc11d50c4862a1cd85a67235333e May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'de01a9c3-c4f1-40b6-af5b-2bf29124b10e'} May 10 15:04:44.029865 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. (HTTP 404) (Request-ID: req-224d003c-91a4-49f5-8007-e056d24a9352) May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.030627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:04:44.031772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 15:04:44.032924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3d6e1f08-9173-42b5-88ad-36b7ffec4311 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Returning 404 to user: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3d6e1f08-9173-42b5-88ad-36b7ffec4311 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e" status: 404 len: 109 microversion: 2.1 time: 0.034497 May 10 15:04:44.033934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 142/266] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:04:43 2022] GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:04:44.044164 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-069619f1-5806-46e1-a9c0-bc37bbaeb7b6 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d7a9d0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:44.075618 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-069619f1-5806-46e1-a9c0-bc37bbaeb7b6 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] HTTP exception thrown: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-069619f1-5806-46e1-a9c0-bc37bbaeb7b6 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Request method failure captured: May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: DELETE /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e HTTP/1.1 May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien8BDi_-plS-5RFdv1lU19sIql_XujhQsd0DvkLwU9lT7U6C6zpq-d6oA_-HVl8dGJG2a1GZeYkSCFZv3I0Vq40YlYmfU4CNQ3F-7s05ymYHnFeWrDRyPkn8LaCJC-Wb6nNxo8oFxVIxwZ5UolxZevu0k-0BEM6m1hvZmwG5kJCsBfQ May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:04:44.077597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2bb3fc11d50c4862a1cd85a67235333e May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'de01a9c3-c4f1-40b6-af5b-2bf29124b10e'} May 10 15:04:44.078811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. (HTTP 404) (Request-ID: req-5bf417b0-638c-477b-892e-40c7b5c88d8b) May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.079546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 15:04:44.080567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 15:04:44.081707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-069619f1-5806-46e1-a9c0-bc37bbaeb7b6 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Returning 404 to user: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-069619f1-5806-46e1-a9c0-bc37bbaeb7b6 tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e" status: 404 len: 109 microversion: 2.1 time: 0.038481 May 10 15:04:44.082833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 143/267] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:04:44 2022] DELETE /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 15:04:44.088617 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a709cfc2-46bc-4af9-bb2f-9658074b732b tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Calling method '.version_select at 0x7f7de0d7e3a0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:44.117143 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-a709cfc2-46bc-4af9-bb2f-9658074b732b tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] HTTP exception thrown: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a709cfc2-46bc-4af9-bb2f-9658074b732b tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Request method failure captured: May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e HTTP/1.1 May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien8BDi_-plS-5RFdv1lU19sIql_XujhQsd0DvkLwU9lT7U6C6zpq-d6oA_-HVl8dGJG2a1GZeYkSCFZv3I0Vq40YlYmfU4CNQ3F-7s05ymYHnFeWrDRyPkn8LaCJC-Wb6nNxo8oFxVIxwZ5UolxZevu0k-0BEM6m1hvZmwG5kJCsBfQ May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:04:44.119673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/27ba9785cb054a34b8f075ed8a5d9c82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 27ba9785cb054a34b8f075ed8a5d9c82 May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358742455 May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2bb3fc11d50c4862a1cd85a67235333e May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358742455-project May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'de01a9c3-c4f1-40b6-af5b-2bf29124b10e'} May 10 15:04:44.121082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. (HTTP 404) (Request-ID: req-a5858d91-cd37-4c14-baeb-4d8bed932352) May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.122217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:04:44.123474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 15:04:44.124478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a709cfc2-46bc-4af9-bb2f-9658074b732b tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] Returning 404 to user: Volume de01a9c3-c4f1-40b6-af5b-2bf29124b10e could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a709cfc2-46bc-4af9-bb2f-9658074b732b tempest-VolumesSnapshotsTestJSON-1358742455 tempest-VolumesSnapshotsTestJSON-1358742455-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e" status: 404 len: 109 microversion: 2.1 time: 0.036255 May 10 15:04:44.125477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 144/268] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:04:44 2022] GET /compute/v2.1/os-volumes/de01a9c3-c4f1-40b6-af5b-2bf29124b10e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 15:04:45.016187 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:45.016926 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:45.024035 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:45.025101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:45.026244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:45.027596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:45.266434 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:45.276282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-26a06f06-e4a7-4692-a88d-14a36ee2a20b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.267646 May 10 15:04:45.277166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 145/269] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:45 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:46.293419 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:46.294029 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:46.301876 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:46.302130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:46.302931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:46.303370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:46.439676 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:46.448020 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5a70dc17-1678-4978-942a-658dd049f553 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.158387 May 10 15:04:46.448591 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 146/270] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:46 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:47.197647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1275143144", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "networks": [{"uuid": "4a990ff4-90f0-4bc3-98dd-9672adbd9125"}]}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:51.075304 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] validate_networks() for None {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:04:51.080252 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] validate_networks() for [('4a990ff4-90f0-4bc3-98dd-9672adbd9125', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:04:51.450611 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:04:51.451030 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:04:51.451504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:04:51.452032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:04:51.452446 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:04:51.461773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:51.462354 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:51.463252 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:51.463932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:51.482510 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Getting quotas for project c9d3d605483a4228bd54793a27723c91. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:04:51.486344 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Getting quotas for user 3bd41b34f5b14ae0a0ebccec9d59944f and project c9d3d605483a4228bd54793a27723c91. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:04:51.497902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:04:51.502172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:04:51.549611 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-47ebbeff-7713-4043-9398-9edecf2ab49f tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.356296 May 10 15:04:51.550417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 147/271] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 15:04:51.558747 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:51.559278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:51.572148 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:51.572513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:51.573368 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:51.573806 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:51.584640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:04:51.585063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:04:51.585566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:04:51.586745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:04:51.587158 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:04:51.598016 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:51.599220 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:51.600259 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:51.600690 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:51.623232 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Getting quotas for project 2954db13c70c43b98c05d392089b3a93. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:04:51.628297 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Getting quotas for user 327ee22061174279a140e12445039b60 and project 2954db13c70c43b98c05d392089b3a93. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:04:51.642489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:04:51.644890 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:04:51.699597 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-efea3ced-f4de-48db-9539-c5b6ff3cbbde tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.533133 May 10 15:04:51.700762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 125/272] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:04:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 10535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:04:51.716688 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7ab46460-bcdb-4a3e-86cd-51309d3e4c7c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:51.717298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7ab46460-bcdb-4a3e-86cd-51309d3e4c7c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:51.761631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:51.778858 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d6e99b8d-f46d-48a4-a067-95a28e667b08 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.226018 May 10 15:04:51.780921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 148/273] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:51 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:51.792800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-37a812f4-43ec-4f39-a782-a26fc93a12bf tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:51.793751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-37a812f4-43ec-4f39-a782-a26fc93a12bf tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:51.806945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7ab46460-bcdb-4a3e-86cd-51309d3e4c7c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:51.814286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7ab46460-bcdb-4a3e-86cd-51309d3e4c7c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1214 microversion: 2.1 time: 0.101424 May 10 15:04:51.820416 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 126/274] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:51 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:51.860712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-37a812f4-43ec-4f39-a782-a26fc93a12bf tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:51.872366 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-37a812f4-43ec-4f39-a782-a26fc93a12bf tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1215 microversion: 2.1 time: 0.089374 May 10 15:04:51.873762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 149/275] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:51 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:52.796018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:52.796631 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:52.803209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:52.803665 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:52.804467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:52.804906 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:52.839869 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:52.840820 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:52.849010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:52.849466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:52.850247 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:52.850716 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:52.913318 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:52.924649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b41807a9-df24-41e6-9856-607605004fb3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1266 microversion: 2.1 time: 0.090689 May 10 15:04:52.929707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 150/276] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:52 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:52.935600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:52.936222 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:52.946303 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:52.947221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:52.948880 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:52.949484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:52.949723 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:52.958960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e778c600-be41-481d-8905-540e202d3bf9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.166843 May 10 15:04:52.959725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 127/277] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:52 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:53.019680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:53.027672 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f9b4dd1c-e4f5-4a9b-acc3-1ee797e4e405 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1211 microversion: 2.1 time: 0.096528 May 10 15:04:53.028245 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 151/278] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:52 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:53.941051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:53.941684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:53.948830 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:53.949285 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:53.950071 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:53.950543 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:53.979343 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:53.991058 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:54.000259 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:54.001443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:54.002296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:54.003098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:54.018546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:54.027729 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-24d1ae04-99c2-4aaa-9fe9-8cef6f47de47 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1272 microversion: 2.1 time: 0.090504 May 10 15:04:54.028533 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 128/279] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:53 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:54.046827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:54.047304 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:54.053238 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:54.053697 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:54.055184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:54.055630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:54.120467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:54.136994 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-155240a3-192e-4fa0-a336-84edbc2a36fa tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1275 microversion: 2.1 time: 0.094328 May 10 15:04:54.137594 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 129/280] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:54 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:54.286900 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:54.296895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c950179b-66fd-478d-ba6c-c65ba37efcee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.320832 May 10 15:04:54.296997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 152/281] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:53 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:55.044836 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:55.045458 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:55.052188 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:55.052640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:55.053413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:55.053849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:55.153932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:55.155083 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:55.162031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:55.162508 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:55.163271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:55.163858 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:55.195891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:55.203343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a0c6b2eb-5f27-480a-9e87-4ebe01954e3b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.162290 May 10 15:04:55.204009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 130/282] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:55 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:55.281940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:55.290240 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-eec957c8-7b8c-45dc-b626-1b1791313872 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1273 microversion: 2.1 time: 0.140017 May 10 15:04:55.291158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 153/283] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:55 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:55.312900 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:55.313514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:55.319278 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:55.319721 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:55.320480 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:55.320909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:55.455271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:55.463015 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cb9fbce7-a388-4603-8666-33a429c2a288 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.153888 May 10 15:04:55.463786 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 131/284] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:55 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:55.695738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-80207cf9-b172-4c16-8749-fefd82ec0e51 req-941266ae-93b1-4303-9e13-0db417ec7326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ac2ad8-af1d-4518-8620-316d4d06db22", "tag": "cad9fcc5-78df-4a88-bc1a-7c3eff5f7be9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:55.704314 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-80207cf9-b172-4c16-8749-fefd82ec0e51 req-941266ae-93b1-4303-9e13-0db417ec7326 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:55.704778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-80207cf9-b172-4c16-8749-fefd82ec0e51 req-941266ae-93b1-4303-9e13-0db417ec7326 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:55.716640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-80207cf9-b172-4c16-8749-fefd82ec0e51 req-941266ae-93b1-4303-9e13-0db417ec7326 service nova] Creating event network-changed:cad9fcc5-78df-4a88-bc1a-7c3eff5f7be9 for instance a8ac2ad8-af1d-4518-8620-316d4d06db22 on hv-cinder-83962 May 10 15:04:55.721767 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-80207cf9-b172-4c16-8749-fefd82ec0e51 req-941266ae-93b1-4303-9e13-0db417ec7326 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031262 May 10 15:04:55.722416 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 154/285] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:56.223826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:56.224451 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:56.230481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:56.230945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:56.231726 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:56.232347 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:56.310282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:56.310282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:56.317209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:56.317781 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:56.318751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:56.319199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:56.406598 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:56.416215 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7f52065f-6849-47c9-a6b6-2a81246b6334 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.196676 May 10 15:04:56.417264 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 132/286] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:56 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:56.480995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:56.481944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:56.488422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:56.489376 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:56.490827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:56.491517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:56.597899 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:56.605619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4b504e09-e679-4fd3-8484-09e21f5c0361 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.301632 May 10 15:04:56.606527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 155/287] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:56 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:56.629642 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:56.637619 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-69a9bf6a-5a3e-4ddc-a53b-4ca610ef664f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.161172 May 10 15:04:56.638204 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 133/288] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:56 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:57.432858 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:57.433469 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:57.439378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:57.439826 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:57.440582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:57.441025 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:57.579569 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:57.588564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6f34d743-eba2-4d5c-a58d-f177b066d73a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.159489 May 10 15:04:57.589517 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 156/289] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:57 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:57.622912 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:57.623704 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:57.630933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:57.631588 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:57.635165 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:57.635611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:57.655036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:57.655657 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:57.662902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:57.663360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:57.664286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:57.664631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:57.778023 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:57.785825 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ba1f5ddb-763f-4baf-9cc7-b1c398473456 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.167398 May 10 15:04:57.787099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 134/290] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:57 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:57.791708 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-232dfc2e-9625-4cae-9266-3c11c16e1ef1 req-9baf6912-1d9e-437c-912e-5a246809c0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91aa6fbc-4812-46a4-a862-bd16073f9999", "tag": "76778285-73b5-415f-a934-78290d21128d"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:04:57.799750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-232dfc2e-9625-4cae-9266-3c11c16e1ef1 req-9baf6912-1d9e-437c-912e-5a246809c0f8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:57.800197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-232dfc2e-9625-4cae-9266-3c11c16e1ef1 req-9baf6912-1d9e-437c-912e-5a246809c0f8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:57.811107 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-232dfc2e-9625-4cae-9266-3c11c16e1ef1 req-9baf6912-1d9e-437c-912e-5a246809c0f8 service nova] Creating event network-changed:76778285-73b5-415f-a934-78290d21128d for instance 91aa6fbc-4812-46a4-a862-bd16073f9999 on hv-cinder-83962 May 10 15:04:57.816170 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-232dfc2e-9625-4cae-9266-3c11c16e1ef1 req-9baf6912-1d9e-437c-912e-5a246809c0f8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027718 May 10 15:04:57.816770 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 135/291] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:04:57.816898 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:57.824713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-256cf4d4-733c-4b11-9c9a-4215332aabd1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.173477 May 10 15:04:57.825283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 157/292] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:57 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:58.605238 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:58.605934 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:58.611993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:58.612444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:58.613271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:58.613713 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:58.747926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:58.755475 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-79d84b3a-6a07-4940-a69b-ecc66cf2bc90 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.154228 May 10 15:04:58.756047 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 136/293] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:58 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:58.806957 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:58.806957 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:58.815271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:58.816097 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:58.817945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:58.819355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:58.844616 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:58.845769 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:58.855628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:58.856401 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:58.857400 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:58.858805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:59.107211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:59.118116 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d7980b36-7ee7-4252-9d54-b45b9f9a696a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.317639 May 10 15:04:59.120020 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 158/294] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:58 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:04:59.234980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:04:59.250631 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b05633de-25c5-4e27-9a24-6c344a150487 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.413139 May 10 15:04:59.252735 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 137/295] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:58 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:04:59.773898 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:04:59.774547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:04:59.780760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:59.781216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:04:59.781999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:04:59.782684 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:00.020401 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:00.032590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-079ba56c-b7e1-4e1a-bc13-73cd0b60e746 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.263348 May 10 15:05:00.033192 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 159/296] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:04:59 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:00.135856 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:00.136590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:00.142877 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:00.143329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:00.144093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:00.144523 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:00.268547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:00.269161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:00.276793 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:00.277259 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:00.278050 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:00.278544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:00.278708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:00.286553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-19800a25-923e-4944-8e00-3704965bbb1b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.155126 May 10 15:05:00.287330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 138/297] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:00 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:00.409991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:00.417312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-66e16e11-e9f5-4ccc-8362-22f0ea449b34 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.152885 May 10 15:05:00.417889 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 160/298] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:00 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:01.054862 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:01.056020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:01.063422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:01.063948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:01.064882 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:01.065589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:01.190647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-a1c4870c-e7d6-4cb9-8948-69666622dc22 req-26c95fba-90e4-40e8-a691-e4feb9464e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ac2ad8-af1d-4518-8620-316d4d06db22", "name": "network-vif-plugged", "status": "completed", "tag": "cad9fcc5-78df-4a88-bc1a-7c3eff5f7be9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:01.202411 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-a1c4870c-e7d6-4cb9-8948-69666622dc22 req-26c95fba-90e4-40e8-a691-e4feb9464e47 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:01.202920 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-a1c4870c-e7d6-4cb9-8948-69666622dc22 req-26c95fba-90e4-40e8-a691-e4feb9464e47 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:01.203511 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:01.211678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-74c4087b-637a-4ba4-b8dd-d75888ff7498 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.165819 May 10 15:05:01.214442 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 139/299] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:01 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:01.215955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-a1c4870c-e7d6-4cb9-8948-69666622dc22 req-26c95fba-90e4-40e8-a691-e4feb9464e47 service nova] Creating event network-vif-plugged:cad9fcc5-78df-4a88-bc1a-7c3eff5f7be9 for instance a8ac2ad8-af1d-4518-8620-316d4d06db22 on hv-cinder-83962 May 10 15:05:01.222415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-a1c4870c-e7d6-4cb9-8948-69666622dc22 req-26c95fba-90e4-40e8-a691-e4feb9464e47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 May 10 15:05:01.223007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 161/300] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:05:01.303436 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:01.304053 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:01.309756 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:01.310206 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:01.311021 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:01.311452 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:01.435375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:01.436114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:01.440171 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:01.442252 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:01.442747 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:01.443528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:01.443971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:01.448397 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-14371701-733e-495a-9157-f3ecdd30fd50 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.148906 May 10 15:05:01.448966 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 140/301] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:01 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:01.578737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:01.587603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7137bdeb-797d-4edc-8289-d26bc35b9a5e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.156395 May 10 15:05:01.588407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 162/302] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:01 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:02.228973 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:02.229581 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:02.235929 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:02.236370 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:02.237124 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:02.237557 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:02.362637 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:02.370749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e730cf62-c9c0-4d4d-a323-e95b76dbf33d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.146067 May 10 15:05:02.371601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 141/303] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:02 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:02.465386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:02.466024 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:02.471948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:02.472398 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:02.473154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:02.473589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:02.600681 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:02.604385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:02.605003 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:02.608682 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f42409c1-cf03-45ac-9004-5b71fba030b4 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.147056 May 10 15:05:02.609595 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 163/304] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:02 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:02.611573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:02.612227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:02.613245 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:02.613813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:02.743064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:02.750705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9e68e3f2-a997-4179-a016-e3257b535163 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.150658 May 10 15:05:02.751429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 142/305] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:02 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:03.387743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:03.388354 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:03.394290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:03.394772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:03.395534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:03.395972 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:03.518204 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:03.525946 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8ff439ad-ffcd-477d-9d15-cff2f835f457 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.142018 May 10 15:05:03.526544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 164/306] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:03 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:03.625567 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:03.626187 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:03.633089 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:03.633481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:03.634250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:03.634721 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:03.761310 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:03.768113 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:03.768724 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:03.768858 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-60479797-1fea-4965-b6b3-922ef142764b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.147460 May 10 15:05:03.769440 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 143/307] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:03 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:03.775197 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:03.775646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:03.776413 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:03.776850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:03.903996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:03.911289 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f5f67ead-7614-4929-8083-be5b94c1aff2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.146965 May 10 15:05:03.911863 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 165/308] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:03 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:04.543156 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:04.543699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:04.549623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:04.550077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:04.550873 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:04.551314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:04.677725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:04.685242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d4900cbb-01a6-4fda-998a-1578ae234906 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.146557 May 10 15:05:04.685814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 144/309] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:04 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:04.786060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:04.786952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:04.793545 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:04.794005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:04.794858 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:04.795365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:04.925322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:04.928141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:04.928761 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:04.932928 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c6ab4620-6c4c-4a3e-9d83-91821fb4c62a tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.150748 May 10 15:05:04.933523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 166/310] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:04 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:04.934659 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:04.935123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:04.935895 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:04.936335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:05.064200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:05.072402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1a081fce-e986-4cad-b19f-7b81f0f7545e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.148021 May 10 15:05:05.073420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 145/311] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:04 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:05.701685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:05.702202 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:05.708271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:05.708721 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:05.709479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:05.709910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:05.833741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:05.840891 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ed1d2b6d-e6e9-412e-8fba-cc3a74f46bfb tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.143151 May 10 15:05:05.841455 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 167/312] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:05 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:05.949288 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:05.949907 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:05.956484 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:05.956876 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:05.957653 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:05.958099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:06.089078 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:06.089625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:06.095861 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:06.096232 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:06.096817 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:06.097939 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:06.098517 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:06.104424 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-61784eba-69d7-4d19-bef8-6ed7143bc51f tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.158939 May 10 15:05:06.105022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 146/313] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:05 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:06.242100 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:06.249799 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6e0fdb16-7060-4fc4-85fb-ca829b547075 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.164510 May 10 15:05:06.250412 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 168/314] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:06 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:06.857814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:06.858448 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:06.860158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-58f6a50e-5970-4793-b8cd-f9fec5848c3a req-a1340617-35e2-4ba5-82fd-9227a33ddf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aa6fbc-4812-46a4-a862-bd16073f9999", "name": "network-vif-plugged", "status": "completed", "tag": "76778285-73b5-415f-a934-78290d21128d"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:06.864535 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:06.864986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:06.865762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:06.866196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:06.869037 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-58f6a50e-5970-4793-b8cd-f9fec5848c3a req-a1340617-35e2-4ba5-82fd-9227a33ddf82 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:06.869784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-58f6a50e-5970-4793-b8cd-f9fec5848c3a req-a1340617-35e2-4ba5-82fd-9227a33ddf82 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:06.881934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-58f6a50e-5970-4793-b8cd-f9fec5848c3a req-a1340617-35e2-4ba5-82fd-9227a33ddf82 service nova] Creating event network-vif-plugged:76778285-73b5-415f-a934-78290d21128d for instance 91aa6fbc-4812-46a4-a862-bd16073f9999 on hv-cinder-83962 May 10 15:05:06.886917 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-58f6a50e-5970-4793-b8cd-f9fec5848c3a req-a1340617-35e2-4ba5-82fd-9227a33ddf82 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030370 May 10 15:05:06.887699 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 169/315] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:05:07.001530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:07.009167 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-820d66ef-af1d-403e-b6cd-9ac0d7fdf622 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.155184 May 10 15:05:07.009733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 147/316] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:06 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:07.121831 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:07.122595 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:07.128630 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:07.129084 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:07.129889 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:07.130331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:07.255305 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:07.263083 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-28c4cf4e-d7e3-4861-8203-65eb03287b69 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.145714 May 10 15:05:07.263651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 170/317] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:07 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:07.266735 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:07.267446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:07.274465 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:07.275341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:07.275910 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:07.276351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:07.407307 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:07.414712 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6a6878fd-4b3b-4d68-9516-7f68db288f44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.152229 May 10 15:05:07.415295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 148/318] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:07 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:08.025775 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:08.026404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:08.032255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:08.032715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:08.033489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:08.033932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:08.195209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:08.203171 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-875e2fda-4701-4b17-b938-09e6bbe70d72 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1314 microversion: 2.1 time: 0.181229 May 10 15:05:08.203779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 171/319] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:08 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:08.279896 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:08.281071 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:08.289193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:08.289880 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:08.290776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:08.291210 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:08.435367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:08.435986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:08.443148 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:08.450341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c9bf0252-076f-41dc-89f9-85f5894ea813 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.174324 May 10 15:05:08.450954 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 149/320] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:08 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:08.453285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:08.453745 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:08.454561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:08.455344 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:08.606864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:08.616195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1dbcf9cb-6815-4ba7-af0e-9dea5ab8e1f3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.184527 May 10 15:05:08.617128 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 172/321] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:08 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:09.219610 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:09.220260 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:09.226097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.226587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:09.227436 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.227955 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:09.358017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:09.365537 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8f8dfffe-c49d-42ae-8fac-e0d0f31a6a5c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1498 microversion: 2.1 time: 0.149872 May 10 15:05:09.366110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 150/322] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:09 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:09.468856 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:09.469558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:09.477185 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.477703 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:09.478502 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.478938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:09.630862 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:09.636446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:09.637693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:09.642289 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-748f5f05-79f2-4299-8ea9-4861168c0831 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.177944 May 10 15:05:09.644056 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 173/323] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:09 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:09.655357 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.656387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:09.656599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.657044 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:09.825274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:09.835541 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-da00e777-88fa-45a4-b975-1a34feb5ad52 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.205216 May 10 15:05:09.849349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 151/324] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:09 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:09.968292 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:09.969130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:09.976837 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.977464 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:09.984481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:09.985228 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:10.016890 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:05:10.113141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-831f27e1-219e-4b07-a642-5e8418182391 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 204 len: 0 microversion: 2.1 time: 0.148672 May 10 15:05:10.114272 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 174/325] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:05:09 2022] DELETE /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:05:10.131595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:10.132393 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:10.152623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:10.153082 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:10.153885 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:10.154326 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:10.385593 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:10.393717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0b4ebbce-efc5-4fe0-836b-b9730118497d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.274582 May 10 15:05:10.394222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 152/326] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:10 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:10.661818 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:10.662739 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:10.668994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:10.669439 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:10.670259 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:10.670774 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:10.809941 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:10.817216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8205a847-22a7-42d4-ae5b-ceb47dbfb339 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.159949 May 10 15:05:10.817798 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 175/327] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:10 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:10.856567 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:10.857532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:10.863929 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:10.864864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:10.865895 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:10.867253 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:11.019364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:11.027958 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4872de75-3db4-4309-97e2-1daabe2815af tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.175294 May 10 15:05:11.028553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 153/328] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:10 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:11.410635 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:11.411241 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:11.417577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:11.418016 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:11.418797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:11.419231 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:11.554449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:11.563156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-88c469f6-d6c9-40b4-a648-0c7a3896537d tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.156244 May 10 15:05:11.563675 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 176/329] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:11 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:11.834548 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:11.835705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:11.841899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:11.842348 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:11.843149 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:11.843559 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:11.987572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:11.996827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8adc8c54-bd78-4efe-9ea0-34c4e446b599 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.165863 May 10 15:05:11.997416 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 154/330] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:11 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:12.045002 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:12.045690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:12.051750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:12.052286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:12.053078 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:12.053508 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:12.180843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:12.188828 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a5dd4d69-c6a1-4f17-b2ab-e70a9bbe9404 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.148038 May 10 15:05:12.189787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 177/331] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:12 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:12.579403 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:12.580051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:12.585874 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:12.586328 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:12.587131 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:12.587566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:12.729395 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:12.736762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8d6a4c1c-ec56-43df-aa8a-8fe65e6e695c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.161186 May 10 15:05:12.737334 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 155/332] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:12 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:13.016577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:13.017418 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:13.023429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:13.023883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:13.024656 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:13.025093 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:13.164412 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:13.172123 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9faa3461-fac5-4305-a92c-84f566e7e54c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.162127 May 10 15:05:13.172785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 178/333] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:13 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:13.206095 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:13.206827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:13.216058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:13.216505 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:13.217273 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:13.217699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:13.349022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:13.359864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-00de900f-882f-4189-af93-04b7bd1ddcaf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.157724 May 10 15:05:13.360436 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 156/334] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:13 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:13.754851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:13.755471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:13.761468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:13.761913 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:13.762809 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:13.763302 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:13.894114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:13.902099 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a41061eb-aa1c-4385-8375-8036d4225e0a tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.151135 May 10 15:05:13.902709 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 179/335] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:13 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:14.188847 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:14.189463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:14.195855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:14.196330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:14.197092 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:14.197521 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:14.329054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:14.336838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c0867417-7dc8-47cf-b2b7-0411cf7dfe95 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1315 microversion: 2.1 time: 0.151733 May 10 15:05:14.337406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 157/336] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:14 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:14.377470 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:14.378169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:14.385306 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:14.385762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:14.386678 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:14.387326 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:14.556803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:14.566755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-740b868e-ac62-4d03-a286-65030350a5ef tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.192868 May 10 15:05:14.567391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 180/337] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:14 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:14.919398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:14.920230 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:14.927049 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:14.927590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:14.928663 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:14.929737 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.061184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:15.068897 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0c414a04-abed-4278-9973-0cb4c045b872 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.153509 May 10 15:05:15.069553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 158/338] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:14 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:15.353846 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:15.354483 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:15.360202 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.360646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.361407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.361832 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.516591 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:15.524921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-36781beb-062c-40d8-bec4-a812a116df75 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1465 microversion: 2.1 time: 0.175826 May 10 15:05:15.525500 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 181/339] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:15 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1465 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:15.564029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:15.565207 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:15.572529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.573197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.574022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.574498 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.584902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:15.586088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:15.592150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.592877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.593926 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.594567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.612869 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:05:15.705682 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ed2321bd-9cbf-4a97-918d-bd10fcdee9b1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "DELETE /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 204 len: 0 microversion: 2.1 time: 0.145033 May 10 15:05:15.709337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 159/340] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:05:15 2022] DELETE /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:05:15.716668 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:15.718370 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:15.725411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.727336 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.727976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:15.728569 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:15.751392 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:15.758975 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1dff9f4f-65cf-445b-b8be-abbb470d740d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.177862 May 10 15:05:15.759561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 182/341] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:15 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:15.876865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:15.886674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a19a10d8-4306-4074-b675-807f309f7c3b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1471 microversion: 2.1 time: 0.175269 May 10 15:05:15.887320 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 160/342] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:15 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:16.086448 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:16.087074 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:16.093424 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:16.093872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:16.094673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:16.095109 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:16.236421 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:16.243683 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8a4a1905-fd95-40b3-b5e3-b748c24efac2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.161714 May 10 15:05:16.244255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 183/343] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:16 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:16.783839 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:16.783839 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:16.783839 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:16.784471 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:16.785256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:16.785891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:16.904367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:16.904981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:16.926555 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:16.927417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:16.929392 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:16.930068 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:16.931169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:16.939672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3e7a1d28-30f8-4388-9139-0a22a2971539 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.167513 May 10 15:05:16.940326 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 161/344] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:16 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:17.073300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:17.080854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8841ae92-10cc-49b1-a0b5-373a55b04001 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1471 microversion: 2.1 time: 0.180653 May 10 15:05:17.081642 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 184/345] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:16 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:17.261446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:17.262143 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:17.268022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:17.268550 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:17.269394 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:17.269932 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:17.434798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:17.442409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a6828d3f-5d45-45b8-9048-f7e4f59f7289 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.185237 May 10 15:05:17.453029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 162/346] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:17 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:17.957444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:17.958069 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:17.965583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:17.965583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:17.965976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:17.966537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:18.095157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:18.097926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:18.098580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:18.103227 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2a1acb31-1fd4-443c-9352-422bc18d8113 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.150131 May 10 15:05:18.103807 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 185/347] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:17 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:18.105387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:18.105841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:18.106647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:18.107085 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:18.232488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:18.239809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c2c29edb-094c-4af9-b1cc-585fdd85b075 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1471 microversion: 2.1 time: 0.145612 May 10 15:05:18.240381 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 163/348] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:18 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:18.460333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:18.461107 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:18.466955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:18.467399 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:18.468157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:18.468586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:18.607062 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:18.615038 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8e68c856-ad88-413a-a8c7-9ede7ef63a35 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.159368 May 10 15:05:18.615696 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 186/349] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:18 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:19.120015 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:19.120668 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:19.127429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:19.127884 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:19.128654 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:19.129098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:19.256156 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:19.257821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:19.258464 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:19.264413 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:19.264879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:19.265121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-227605b2-0fd3-4cf6-88c0-2889febd8ffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.148663 May 10 15:05:19.265695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:19.265851 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 164/350] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:19 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:19.266140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:19.401678 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:19.409062 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-64743e5b-0f19-49c1-900a-f7e45b0c427c tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1471 microversion: 2.1 time: 0.155882 May 10 15:05:19.409647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 187/351] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:19 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:19.639620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:19.640465 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:19.649102 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:19.649553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:19.650336 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:19.650813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:19.784076 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:19.792511 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9a1ceae6-c004-4273-97e5-c4efcbf3d4c2 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.161933 May 10 15:05:19.793091 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 165/352] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:19 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:20.281791 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:20.282594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:20.291889 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:20.292346 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:20.293124 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:20.293561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:20.426648 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:20.428296 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:20.436168 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:20.436916 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:20.438017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:20.438694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:20.504977 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:20.512562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-983441a1-e754-486c-9b0a-63c6ad282548 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.234548 May 10 15:05:20.513251 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 188/353] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:20 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:20.655971 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:20.663934 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2c728f77-e4ab-4068-8929-e94cf3704f0b tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1471 microversion: 2.1 time: 0.241338 May 10 15:05:20.664508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 166/354] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:20 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:20.810837 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:20.811448 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:20.817893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:20.819370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:20.819760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:20.820385 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:21.168074 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-220c83d3-6e8b-4b3d-aee4-781b6fcf16bd req-fe2d5188-2470-4af1-a1a2-2790d8ebfc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ac2ad8-af1d-4518-8620-316d4d06db22", "name": "network-vif-deleted", "tag": "cad9fcc5-78df-4a88-bc1a-7c3eff5f7be9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:21.173491 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:21.176573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-220c83d3-6e8b-4b3d-aee4-781b6fcf16bd req-fe2d5188-2470-4af1-a1a2-2790d8ebfc84 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:21.176897 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-220c83d3-6e8b-4b3d-aee4-781b6fcf16bd req-fe2d5188-2470-4af1-a1a2-2790d8ebfc84 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:21.185646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d14d5b4f-64de-40f5-ba29-fdd225688fbf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1504 microversion: 2.1 time: 0.379220 May 10 15:05:21.196072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-220c83d3-6e8b-4b3d-aee4-781b6fcf16bd req-fe2d5188-2470-4af1-a1a2-2790d8ebfc84 service nova] Creating event network-vif-deleted:cad9fcc5-78df-4a88-bc1a-7c3eff5f7be9 for instance a8ac2ad8-af1d-4518-8620-316d4d06db22 on hv-cinder-83962 May 10 15:05:21.196072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-220c83d3-6e8b-4b3d-aee4-781b6fcf16bd req-fe2d5188-2470-4af1-a1a2-2790d8ebfc84 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029621 May 10 15:05:21.196072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 167/355] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:05:21.197675 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 189/356] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:20 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:21.530521 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:21.531225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:21.539652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:21.540462 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:21.542652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:21.543534 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:21.681083 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:21.682327 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:21.690232 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:21.690721 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:21.691505 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:21.699815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:21.764039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:21.773568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4d0f8b5d-2001-4348-9676-99acf9e59af6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1520 microversion: 2.1 time: 0.246596 May 10 15:05:21.775158 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 168/357] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:21 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:21.795076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:21.803075 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-315497e7-0f3e-436e-b7c2-86fa9491cfd5 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1300 microversion: 2.1 time: 0.125958 May 10 15:05:21.803802 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 190/358] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:21 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:22.204440 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:22.205051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:22.213007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.213499 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.214270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.214770 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.245422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.245866 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.246600 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid a8ac2ad8-af1d-4518-8620-316d4d06db22 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:22.289072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:22.296227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-db2697e6-28ad-40af-80ca-02ee31311252 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1304 microversion: 2.1 time: 0.096467 May 10 15:05:22.296790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 169/359] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:22 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:22.791789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:22.792454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:22.798288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.798786 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.799561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.800001 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.820970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:22.821510 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:22.827705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.828153 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.828914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.829355 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.862772 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.863222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.863671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lazy-loading 'fault' on Instance uuid 91aa6fbc-4812-46a4-a862-bd16073f9999 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:22.904007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327ee22061174279a140e12445039b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2954db13c70c43b98c05d392089b3a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:22.911432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3faa5f6e-0775-4d46-9376-3cee7aaf35a1 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 200 len: 1305 microversion: 2.1 time: 0.094317 May 10 15:05:22.912014 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 170/360] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:22 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:22.936817 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:22.944131 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-babaccd1-c7f8-4457-b5ad-150e1f260137 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1500 microversion: 2.1 time: 0.156851 May 10 15:05:22.944711 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 191/361] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:22 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:22.962978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:22.963611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:22.970677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.971305 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:22.972256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:22.972697 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:23.098505 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:23.105745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0ad5de1c-1348-42b8-943d-5ee35080ae6d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1515 microversion: 2.1 time: 0.147758 May 10 15:05:23.106319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 171/362] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:22 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:23.220909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-578466d8-4ccb-47c9-a81b-d6dc6a559c74 req-f9b889e0-795c-4908-950d-e9b07719e239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aa6fbc-4812-46a4-a862-bd16073f9999", "name": "network-vif-deleted", "tag": "76778285-73b5-415f-a934-78290d21128d"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:23.229994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-578466d8-4ccb-47c9-a81b-d6dc6a559c74 req-f9b889e0-795c-4908-950d-e9b07719e239 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:23.230646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-578466d8-4ccb-47c9-a81b-d6dc6a559c74 req-f9b889e0-795c-4908-950d-e9b07719e239 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:23.242587 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-578466d8-4ccb-47c9-a81b-d6dc6a559c74 req-f9b889e0-795c-4908-950d-e9b07719e239 service nova] Creating event network-vif-deleted:76778285-73b5-415f-a934-78290d21128d for instance 91aa6fbc-4812-46a4-a862-bd16073f9999 on hv-cinder-83962 May 10 15:05:23.247925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-578466d8-4ccb-47c9-a81b-d6dc6a559c74 req-f9b889e0-795c-4908-950d-e9b07719e239 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 May 10 15:05:23.248701 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 192/363] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:05:23.314294 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:23.314943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:23.321592 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:23.322045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:23.322853 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:23.323290 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:23.355639 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:23.356106 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:23.356603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid a8ac2ad8-af1d-4518-8620-316d4d06db22 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:23.414044 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:23.437427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a02de17e-114b-4da1-a452-41f28d623269 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 200 len: 1304 microversion: 2.1 time: 0.126832 May 10 15:05:23.438164 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 172/364] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:23 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:23.930286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:23.931097 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] [instance: 91aa6fbc-4812-46a4-a862-bd16073f9999] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:23.937512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:23.938016 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:23.938906 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:23.939349 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:23.952574 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] HTTP exception thrown: Instance 91aa6fbc-4812-46a4-a862-bd16073f9999 could not be found. May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Request method failure captured: May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 HTTP/1.1 May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien8Ezgr1wRKBUrOhLUY_CXeBdWv8Dh3Z_khCcVBjlnmZuKrb9iOxR9K1SRZvOhNw6-6PNQ7ENLxIZbUGHFLdWjh1eRK4LcfQEx3bgy_KOR0RW7aiJEiJGHkyxsowiUn_PBDTAaTpnhCb7S-lu27XCvgGX5H_ctPQZpf7kkF8EYbA3GU May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 2954db13c70c43b98c05d392089b3a93 May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesNegativeTest-738858301 May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:05:23.954206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2954db13c70c43b98c05d392089b3a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2954db13c70c43b98c05d392089b3a93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2954db13c70c43b98c05d392089b3a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2954db13c70c43b98c05d392089b3a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesNegativeTest-738858301 May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 2954db13c70c43b98c05d392089b3a93 May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesNegativeTest-738858301 May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesNegativeTest-738858301-project May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 327ee22061174279a140e12445039b60 May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesNegativeTest-738858301-project May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 91aa6fbc-4812-46a4-a862-bd16073f9999 could not be found. May 10 15:05:23.955783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '91aa6fbc-4812-46a4-a862-bd16073f9999'} May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91aa6fbc-4812-46a4-a862-bd16073f9999 could not be found. May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:05:23.956720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91aa6fbc-4812-46a4-a862-bd16073f9999 could not be found. May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91aa6fbc-4812-46a4-a862-bd16073f9999 could not be found. May 10 15:05:23.958286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:23.959378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] Returning 404 to user: Instance 91aa6fbc-4812-46a4-a862-bd16073f9999 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:05:23.959378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9df9573c-04fa-4de0-8908-8fc48f4c4c80 tempest-VolumesNegativeTest-738858301 tempest-VolumesNegativeTest-738858301-project] 10.222.0.83 "GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999" status: 404 len: 111 microversion: 2.1 time: 0.030300 May 10 15:05:23.959378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 193/365] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:23 2022] GET /compute/v2.1/servers/91aa6fbc-4812-46a4-a862-bd16073f9999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:05:24.457432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:24.458618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: a8ac2ad8-af1d-4518-8620-316d4d06db22] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:24.467538 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:24.468159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:24.469165 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:24.469751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:24.485389 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] HTTP exception thrown: Instance a8ac2ad8-af1d-4518-8620-316d4d06db22 could not be found. May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Request method failure captured: May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 HTTP/1.1 May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien8Nc-H2dt9GDpBQE4zhkTbzO5JHuUtT8kwy-2K5tjlVkQCU9vTETbxy5zXrP0YRYO8_B795MXW6UHnwGcYm-aAGR4LV3M_SIbfYWoUwZej0AMctCrMJwtMLcZ16lXBNkFfTXKn-KaIGYpKcUfTWG2kDpzMHsVLJNfNa3TegDS1eB8Q May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: c9d3d605483a4228bd54793a27723c91 May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-VolumesActionsTest-156483215 May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:05:24.487178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c9d3d605483a4228bd54793a27723c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c9d3d605483a4228bd54793a27723c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c9d3d605483a4228bd54793a27723c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c9d3d605483a4228bd54793a27723c91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-VolumesActionsTest-156483215 May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: c9d3d605483a4228bd54793a27723c91 May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-VolumesActionsTest-156483215 May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-VolumesActionsTest-156483215-project May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 3bd41b34f5b14ae0a0ebccec9d59944f May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-VolumesActionsTest-156483215-project May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance a8ac2ad8-af1d-4518-8620-316d4d06db22 could not be found. May 10 15:05:24.488443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'a8ac2ad8-af1d-4518-8620-316d4d06db22'} May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ac2ad8-af1d-4518-8620-316d4d06db22 could not be found. May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:05:24.489387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ac2ad8-af1d-4518-8620-316d4d06db22 could not be found. May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ac2ad8-af1d-4518-8620-316d4d06db22 could not be found. May 10 15:05:24.491046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:05:24.492314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Returning 404 to user: Instance a8ac2ad8-af1d-4518-8620-316d4d06db22 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:05:24.492314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-81c0976f-e119-46eb-a9ce-06e7b3607902 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22" status: 404 len: 111 microversion: 2.1 time: 0.035437 May 10 15:05:24.492817 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 173/366] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:24 2022] GET /compute/v2.1/servers/a8ac2ad8-af1d-4518-8620-316d4d06db22 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:05:24.495293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:24.496647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:24.503484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:24.504173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:24.505143 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:24.505799 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:24.532755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lazy-loading 'flavor' on Instance uuid 975ddad8-93eb-4cca-8d23-8de0f4637aea {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:24.619135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-879854862", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "networks": [{"uuid": "4a990ff4-90f0-4bc3-98dd-9672adbd9125"}]}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:24.633785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a6b5f754-4b15-4a8c-8e25-80eb20b0eb6b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea/action" status: 200 len: 32 microversion: 2.1 time: 0.144650 May 10 15:05:24.634523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 194/367] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:05:24 2022] POST /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 15:05:24.644979 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:24.646081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:24.654883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:24.655577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:24.657190 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:24.658496 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:24.704589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] validate_networks() for [('4a990ff4-90f0-4bc3-98dd-9672adbd9125', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:05:24.939454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:24.955182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-66939a4f-973f-4d9e-b24d-097007eeda91 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.315246 May 10 15:05:24.955798 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 195/368] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:24 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:25.187964 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:05:25.188810 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:05:25.189587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:05:25.190149 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:05:25.190798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:05:25.205703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:25.206169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:25.207058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:25.207503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:25.231896 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Getting quotas for project c9d3d605483a4228bd54793a27723c91. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:05:25.241838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Getting quotas for user 3bd41b34f5b14ae0a0ebccec9d59944f and project c9d3d605483a4228bd54793a27723c91. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:05:25.253810 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:05:25.256583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:05:25.307148 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-71e9676b-a4df-44e1-917e-ebf2e9274c81 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693356 May 10 15:05:25.308058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 174/369] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:05:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:05:25.318938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-115362f5-2775-47a6-92ed-a576fd08bc01 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:25.319707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-115362f5-2775-47a6-92ed-a576fd08bc01 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:25.432991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-115362f5-2775-47a6-92ed-a576fd08bc01 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:25.442886 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-115362f5-2775-47a6-92ed-a576fd08bc01 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1213 microversion: 2.1 time: 0.128315 May 10 15:05:25.462951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 196/370] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:25 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:25.972663 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:25.973358 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:25.980741 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:25.981290 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:25.982234 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:25.982825 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:26.155540 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:26.166615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fac3ee66-b03f-487d-a9f0-e48518f759b7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.197845 May 10 15:05:26.179221 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 175/371] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:25 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:26.464993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:26.466302 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:26.476875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:26.477429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:26.478291 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:26.478862 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:26.556898 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:26.564797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9be706a6-1251-4423-8dd4-c15baa5435ad tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1265 microversion: 2.1 time: 0.103670 May 10 15:05:26.565610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 197/372] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:26 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:27.198297 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:27.199826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:27.209049 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:27.210491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:27.211464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:27.212086 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:27.384498 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:27.396163 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2acd6f72-87b5-40de-9ae2-63ef0595e710 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.204719 May 10 15:05:27.397612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 176/373] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:27 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:27.588219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:27.588911 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:27.597776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:27.598622 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:27.599732 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:27.600338 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:27.847003 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:27.855974 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7c455232-47d3-435b-91d1-62f227a9c818 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.277002 May 10 15:05:27.867461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 198/374] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:27 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:28.415754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:28.417122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:28.424289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:28.424987 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:28.426337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:28.426934 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:28.541329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-e3517360-da88-4421-a654-c543200d7671 req-cdccfbfd-4b71-4849-b60c-023155e66f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260d2d91-6d19-4624-9c5d-7d615badcae4", "tag": "3612b25c-ff87-4e42-887e-cf1aa4dd58f7"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:28.561327 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-e3517360-da88-4421-a654-c543200d7671 req-cdccfbfd-4b71-4849-b60c-023155e66f36 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:28.562176 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-e3517360-da88-4421-a654-c543200d7671 req-cdccfbfd-4b71-4849-b60c-023155e66f36 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:28.586572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:28.587452 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-e3517360-da88-4421-a654-c543200d7671 req-cdccfbfd-4b71-4849-b60c-023155e66f36 service nova] Creating event network-changed:3612b25c-ff87-4e42-887e-cf1aa4dd58f7 for instance 260d2d91-6d19-4624-9c5d-7d615badcae4 on hv-cinder-83962 May 10 15:05:28.594358 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3d8a4a5c-8bb2-46d5-b961-5ae870b54123 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.182501 May 10 15:05:28.595202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 177/375] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:28 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:28.600331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-e3517360-da88-4421-a654-c543200d7671 req-cdccfbfd-4b71-4849-b60c-023155e66f36 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062764 May 10 15:05:28.601156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 199/376] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:05:28.874335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:28.875603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:28.884045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:28.884504 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:28.885306 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:28.885749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:29.021210 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:29.030356 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-53c07a8f-1161-4694-a694-e528445b5057 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.160766 May 10 15:05:29.031062 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 178/377] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:28 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:29.614442 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:29.615296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:29.622165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:29.622896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:29.623873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:29.624526 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:29.778945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:29.786301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-981375e7-e1b0-46de-868b-534d4b23fcf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.177725 May 10 15:05:29.786914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 200/378] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:29 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:30.054427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:30.054427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:30.054971 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:30.055203 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:30.055989 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:30.056458 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:30.428874 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:30.436083 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b13d3b88-bc6e-4eec-9b7c-8e6b3b570730 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.392511 May 10 15:05:30.436658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 179/379] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:30 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:30.803049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:30.804380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:30.810205 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:30.810698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:30.811469 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:30.811910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:31.013750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:31.021399 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-190aa85b-67da-4b64-9e70-02f78275da44 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.222194 May 10 15:05:31.021984 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 201/380] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:30 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:31.452348 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:31.453159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:31.459123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:31.460170 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:31.461016 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:31.461565 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:31.592596 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:31.599710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0677f2a0-ea22-4ff9-9b14-3e23aa6f20ab tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.151202 May 10 15:05:31.600319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 180/381] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:31 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:32.038832 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:32.039409 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:32.046095 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:32.046760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:32.047552 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:32.047993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:32.186499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:32.193765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4edc815d-0905-4185-a076-2be72196e698 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.159312 May 10 15:05:32.194340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 202/382] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:32 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:32.615316 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:32.615980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:32.622881 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:32.623305 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:32.624089 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:32.624529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:32.763043 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:32.773707 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b5174c17-5bb8-419b-992f-eba7f8ac50bf tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.162133 May 10 15:05:32.774289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 181/383] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:32 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:33.211154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:33.211713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:33.217487 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:33.217945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:33.218741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:33.219183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:33.348528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:33.356576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b9353634-6024-42e0-9531-67ab68616142 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.149897 May 10 15:05:33.357298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 203/384] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:33 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:33.790845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:33.791460 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:33.797541 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:33.798103 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:33.798889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:33.799323 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:33.937360 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:33.945601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-490e2fd6-0115-4b32-86d3-9c27488b28c3 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.158937 May 10 15:05:33.946172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 182/385] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:33 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:34.373450 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:34.374067 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:34.380269 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:34.380722 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:34.382839 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:34.382839 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:34.524269 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:34.531969 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-78bb5067-a88c-4452-b6bd-ca27b012cdc5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.162683 May 10 15:05:34.532860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 204/386] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:34 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:34.962290 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:34.962938 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:34.969212 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:34.969670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:34.970456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:34.970900 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:35.098695 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:35.106365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c6a0f50b-bbaa-4329-b1f4-00cc3b099148 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.147981 May 10 15:05:35.106950 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 183/387] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:34 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:35.465698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ec9b8f80-a9f9-48a3-ae13-00c0891934d5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:35.466228 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ec9b8f80-a9f9-48a3-ae13-00c0891934d5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:35.472105 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f80-a9f9-48a3-ae13-00c0891934d5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:35.472547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f80-a9f9-48a3-ae13-00c0891934d5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:35.473305 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f80-a9f9-48a3-ae13-00c0891934d5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:35.473735 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f80-a9f9-48a3-ae13-00c0891934d5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:35.496207 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ec9b8f80-a9f9-48a3-ae13-00c0891934d5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/ips" status: 200 len: 152 microversion: 2.20 time: 0.034391 May 10 15:05:35.497018 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 205/388] 10.222.0.83 () {60 vars in 1288 bytes} [Tue May 10 15:05:35 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 15:05:35.548622 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:35.549331 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:35.560475 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:35.561176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:35.562267 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:35.563105 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:35.702052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:35.710338 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-aa963d22-4e55-45d1-afab-75529632e9ae tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.164994 May 10 15:05:35.710964 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 184/389] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:35 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:36.122955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:36.123562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:36.129266 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:36.129712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:36.130495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:36.130931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:36.262377 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:36.270188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-cf0141dd-9ff1-4410-b9b9-ac62f1b228fd tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.151315 May 10 15:05:36.270787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 206/390] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:36 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:36.727072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:36.727689 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:36.734149 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:36.734580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:36.735352 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:36.735793 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:36.866289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:36.874068 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3b2c8aaf-71a8-43e8-b6c3-1f1d6c694944 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.150847 May 10 15:05:36.874671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 185/391] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:36 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:37.288761 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:37.289302 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:37.295280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:37.295730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:37.296500 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:37.296939 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:37.428250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:37.436228 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-19dc8a06-068c-4088-8dce-ae92e8d12d71 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.152083 May 10 15:05:37.436801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 207/392] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:37 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:37.473184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6281cb5a-6b52-4d33-99d0-265b6775bf4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:37.473679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6281cb5a-6b52-4d33-99d0-265b6775bf4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:37.480072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6281cb5a-6b52-4d33-99d0-265b6775bf4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:37.480531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6281cb5a-6b52-4d33-99d0-265b6775bf4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:37.481301 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6281cb5a-6b52-4d33-99d0-265b6775bf4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:37.481743 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6281cb5a-6b52-4d33-99d0-265b6775bf4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:37.505011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6281cb5a-6b52-4d33-99d0-265b6775bf4f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/ips" status: 200 len: 147 microversion: 2.1 time: 0.035651 May 10 15:05:37.505601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 186/393] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:05:37 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:05:37.815813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-53b571ca-cbf7-4aed-b9ff-5acb19cd950b req-5ae3bed7-e810-4bc0-b4b5-2094ecd75648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260d2d91-6d19-4624-9c5d-7d615badcae4", "name": "network-vif-plugged", "status": "completed", "tag": "3612b25c-ff87-4e42-887e-cf1aa4dd58f7"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:37.824245 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-53b571ca-cbf7-4aed-b9ff-5acb19cd950b req-5ae3bed7-e810-4bc0-b4b5-2094ecd75648 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:37.824731 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-53b571ca-cbf7-4aed-b9ff-5acb19cd950b req-5ae3bed7-e810-4bc0-b4b5-2094ecd75648 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:37.837331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-53b571ca-cbf7-4aed-b9ff-5acb19cd950b req-5ae3bed7-e810-4bc0-b4b5-2094ecd75648 service nova] Creating event network-vif-plugged:3612b25c-ff87-4e42-887e-cf1aa4dd58f7 for instance 260d2d91-6d19-4624-9c5d-7d615badcae4 on hv-cinder-83962 May 10 15:05:37.842299 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-53b571ca-cbf7-4aed-b9ff-5acb19cd950b req-5ae3bed7-e810-4bc0-b4b5-2094ecd75648 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 May 10 15:05:37.842940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 208/394] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:05:37.890743 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:37.891374 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:37.898279 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:37.898784 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:37.899556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:37.899997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:38.032616 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:38.039943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1f8bfdbf-ff66-43a4-b6b1-1d0166771e06 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.153235 May 10 15:05:38.040494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 187/395] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:37 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:38.453596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:38.454219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:38.460205 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:38.460649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:38.461407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:38.461837 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:38.587772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:38.594948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a25ad71b-2be4-4e04-a94a-663ff037650e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.145601 May 10 15:05:38.595512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 209/396] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:38 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:38.867451 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7b046dce-75bd-488a-ae77-3f798fc4b375 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a24f4754-fefd-446e-b59c-eaab935acdfc"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:38.868576 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7b046dce-75bd-488a-ae77-3f798fc4b375 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:38.874663 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7b046dce-75bd-488a-ae77-3f798fc4b375 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:38.875115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7b046dce-75bd-488a-ae77-3f798fc4b375 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:38.875920 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7b046dce-75bd-488a-ae77-3f798fc4b375 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:38.876359 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7b046dce-75bd-488a-ae77-3f798fc4b375 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.057821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:39.058432 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:39.064221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.064666 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.065436 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.065872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.188462 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:39.195755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ff2f09b7-3c8f-4ef0-ae1b-bd34f3ff4e65 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.142474 May 10 15:05:39.196324 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 210/397] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:39 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:39.447404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:39.447930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:39.454799 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.455406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.456003 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.456604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.482432 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lazy-loading 'flavor' on Instance uuid a4aac7eb-fbec-4d86-82c9-1237542ad61a {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:39.608850 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7b046dce-75bd-488a-ae77-3f798fc4b375 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745766 May 10 15:05:39.614841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 188/398] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:05:38 2022] POST /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:05:39.621298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:39.622666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:39.629731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.630178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.631014 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.632159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.780718 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-61d22fc5-f5f9-49cb-917f-f7eba6b8fe98 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/action" status: 202 len: 0 microversion: 2.20 time: 0.336743 May 10 15:05:39.785195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 211/399] 10.222.0.83 () {62 vars in 1318 bytes} [Tue May 10 15:05:39 2022] POST /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 15:05:39.792126 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:39.793032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:39.799196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.799701 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.800908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:39.800908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:39.835601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:39.845209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f4829bab-b039-408c-b44a-fd558450222b tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1313 microversion: 2.1 time: 0.229023 May 10 15:05:39.846296 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 189/400] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:39 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:39.946585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:39.954854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:39.957635 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:39.958843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2928be8c-cb3a-4b00-9517-8cf02d9ecf03 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.172501 May 10 15:05:39.959630 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 212/401] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:39 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:40.212542 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:40.213102 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:40.220126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:40.220574 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:40.221363 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:40.221803 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:40.367518 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:40.375912 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5dc6c56a-de74-4a42-b5af-0a9eb4fa3d10 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.167471 May 10 15:05:40.376502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 190/402] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:40 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:40.862519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:40.863072 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:40.869482 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:40.869940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:40.870732 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:40.871169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:40.977562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:40.978179 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:40.984765 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:40.985217 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:40.985989 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:40.986453 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:41.004572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:41.011864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b1a8b774-8d90-4727-a84e-da7530be0b92 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1497 microversion: 2.1 time: 0.153181 May 10 15:05:41.012452 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 213/403] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:40 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:41.118268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:41.126495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:41.128139 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:41.129479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6df00476-6b1a-4346-8446-18950ba93dc5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.156356 May 10 15:05:41.130034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 191/404] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:40 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:05:41.393536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:41.394151 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:41.400782 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:41.401244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:41.402010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:41.402552 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:41.525198 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:41.532413 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-40f0e62a-5b98-47a6-a642-dacfcf0a661e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.142699 May 10 15:05:41.532974 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 214/405] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:41 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:41.803059 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:41.803554 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:41.809433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:41.809875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:41.810674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:41.811104 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:41.838079 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:05:41.912382 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7a6f7c2c-e16c-4e87-98ef-b28c439c0066 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "DELETE /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 204 len: 0 microversion: 2.1 time: 0.112493 May 10 15:05:41.912965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 192/406] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:05:41 2022] DELETE /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:05:41.921787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:41.922559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:41.928617 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:41.929058 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:41.929852 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:41.930283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:42.055338 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:42.062765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b16aade2-756d-4057-b63e-d197780585fe tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1503 microversion: 2.1 time: 0.145376 May 10 15:05:42.063350 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 215/407] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:41 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:42.148554 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:42.149249 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:42.155477 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:42.155917 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:42.156674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:42.157107 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:42.284843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:42.293181 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:42.294698 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:42.295843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-71f5164e-365e-4b89-8849-43199cc0ccc4 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.152043 May 10 15:05:42.296426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 193/408] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:42 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:42.549618 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:42.550153 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:42.556060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:42.556513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:42.557325 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:42.557830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:42.681059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:42.688385 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f1a76c8f-9232-4674-8276-3214ab348132 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.142813 May 10 15:05:42.688958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 216/409] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:42 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:43.080395 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:43.080936 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:43.087455 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:43.087912 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:43.088702 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:43.089143 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:43.214722 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:43.222028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-82c4710b-9c19-4832-b7b9-56c527ebff57 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1503 microversion: 2.1 time: 0.145625 May 10 15:05:43.222636 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 194/410] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:43 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:43.312995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:43.313953 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:43.322351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:43.323136 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:43.323914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:43.324355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:43.451870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:43.459976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:43.461963 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:43.463142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c52373c9-de8d-4115-893c-d9eea81508fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.154052 May 10 15:05:43.463707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 217/411] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:43 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:43.704828 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:43.705438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:43.711269 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:43.711909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:43.712976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:43.713596 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:43.844272 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:43.852183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-764f4b45-4699-42c9-a187-3ba5b8a03d25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.151035 May 10 15:05:43.852762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 195/412] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:43 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:44.239492 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:44.240136 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:44.246870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:44.247319 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:44.248088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:44.248522 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:44.375224 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:44.382594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0ec0c811-7a59-48f2-824e-2d3db747d9e7 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1503 microversion: 2.1 time: 0.147023 May 10 15:05:44.383166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 218/413] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:44 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:44.481684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:44.482288 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:44.488769 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:44.489159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:44.489922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:44.490353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:44.617552 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:44.625701 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:44.627244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:44.628405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c34262ee-6906-4d7a-8609-5b413d465d68 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.150655 May 10 15:05:44.628980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 196/414] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:44 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:44.868465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:44.869127 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:44.875696 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:44.876300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:44.877294 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:44.877737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:44.889958 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-0df583c7-fb58-46cb-ba95-d43c12780a2a req-bf194dce-41fd-45c1-af2e-840af1dd9fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260d2d91-6d19-4624-9c5d-7d615badcae4", "name": "network-vif-deleted", "tag": "3612b25c-ff87-4e42-887e-cf1aa4dd58f7"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:44.901710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-0df583c7-fb58-46cb-ba95-d43c12780a2a req-bf194dce-41fd-45c1-af2e-840af1dd9fa4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:44.902635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-0df583c7-fb58-46cb-ba95-d43c12780a2a req-bf194dce-41fd-45c1-af2e-840af1dd9fa4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:44.924203 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-0df583c7-fb58-46cb-ba95-d43c12780a2a req-bf194dce-41fd-45c1-af2e-840af1dd9fa4 service nova] Creating event network-vif-deleted:3612b25c-ff87-4e42-887e-cf1aa4dd58f7 for instance 260d2d91-6d19-4624-9c5d-7d615badcae4 on hv-cinder-83962 May 10 15:05:44.930845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-0df583c7-fb58-46cb-ba95-d43c12780a2a req-bf194dce-41fd-45c1-af2e-840af1dd9fa4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045146 May 10 15:05:44.932153 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 197/415] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:05:45.065455 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:45.075827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a6c7cac1-c032-43a1-a4f9-e239b6224607 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.211265 May 10 15:05:45.076502 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 219/416] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:44 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:45.399849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:45.400582 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:45.406695 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:45.407148 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:45.407908 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:45.408344 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:45.437798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:45.438243 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:45.438713 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:45.482640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:45.489789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-51728308-91e7-4f7b-b916-539a9cc6e166 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.094172 May 10 15:05:45.490361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 198/417] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:45 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:45.646555 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:45.647196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:45.653162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:45.653551 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:45.654320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:45.654777 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:45.778907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:45.786752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:45.788777 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:45.789922 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8804b3e2-f0a8-41d9-a160-ed0b6a157b2b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.147281 May 10 15:05:45.790509 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 220/418] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:45 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:46.093408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:46.094054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:46.100726 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:46.101181 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:46.101952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:46.102410 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:46.225399 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:46.233561 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-86f90578-c11d-40fa-baa9-2a8307fadf25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.144067 May 10 15:05:46.234169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 199/419] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:46 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:46.507046 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:46.507578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:46.513562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:46.514013 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:46.514796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:46.515232 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:46.544788 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:46.545230 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:46.545670 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:46.591717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:46.598947 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5b9ec570-3a66-4e8b-9ce2-117a3338b690 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.096342 May 10 15:05:46.599520 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 221/420] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:46 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:46.808894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:46.809449 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:46.815723 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:46.816177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:46.816934 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:46.817369 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:46.943681 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:46.951887 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:46.953364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:46.954530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-33e648da-be56-47f2-a1ca-b46a413830fe tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.150026 May 10 15:05:46.955084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 200/421] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:46 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:47.250736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:47.251376 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:47.257248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:47.257691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:47.258468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:47.258901 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:47.382849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:47.390016 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-036552bf-b3f8-43e8-bebe-dd3aeeb62770 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.143432 May 10 15:05:47.390612 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 222/422] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:47 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:47.616961 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:47.617612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:47.625593 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:47.626054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:47.626855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:47.627295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:47.658295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:47.658774 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:47.659219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:47.701193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:47.708418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f789abd9-22dd-4bfd-938f-6b886ce74561 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.096771 May 10 15:05:47.708984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 201/423] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:47 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:47.973047 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:47.973653 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:47.980142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:47.980594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:47.981371 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:47.981787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:48.111953 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:48.120603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:48.122370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:48.123557 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b96e61aa-a16e-4bd6-a13b-6511a0fdee07 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.154414 May 10 15:05:48.124120 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 223/424] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:47 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:48.407371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:48.407984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:48.416399 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:48.416850 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:48.417621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:48.418058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:48.544524 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:48.551856 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c4c8c7bd-156a-448d-b649-079f4114e69a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.148346 May 10 15:05:48.552427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 202/425] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:48 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:48.724971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:48.725577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:48.731353 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:48.731795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:48.732547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:48.732976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:48.762561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:48.762938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:48.763372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:48.805763 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:48.813014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-624e05a0-196a-4b87-a062-88eeddef26c0 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.091973 May 10 15:05:48.813587 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 224/426] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:48 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:49.140971 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:49.141582 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:49.147374 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:49.147823 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:49.148586 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:49.149026 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:49.280532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:49.288827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:49.290322 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:49.291490 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-494c8898-b2be-46d3-85bd-39ed3413072d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.154388 May 10 15:05:49.292041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 203/427] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:49 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:49.569025 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:49.569675 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:49.575616 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:49.576066 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:49.576833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:49.577268 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:49.702815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:49.710622 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-dae49f7d-60c0-4350-ac61-40996e888209 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.145415 May 10 15:05:49.711191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 225/428] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:49 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:49.830091 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:49.830634 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:49.837443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:49.837887 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:49.838678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:49.839114 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:49.874576 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:49.875027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:49.875469 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:49.918334 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:49.925779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c9e5dcf1-8f50-4b53-ae50-a83b6775221e tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.099601 May 10 15:05:49.926345 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 204/429] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:49 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:50.309442 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:50.310049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:50.316592 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:50.317041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:50.317799 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:50.318230 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:50.444772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:50.452563 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:50.454058 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:50.455237 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bc0717c0-98bf-4616-bd10-539f60d0139d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.149631 May 10 15:05:50.455813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 226/430] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:50 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:50.727890 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:50.728514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:50.738971 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:50.739429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:50.740203 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:50.740647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:50.866185 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:50.873792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c26f1de7-7cad-4449-b0cf-fcc9c9095fd6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.150275 May 10 15:05:50.874362 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 205/431] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:50 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:50.942796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:50.943557 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:50.949386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:50.949841 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:50.950648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:50.951091 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:50.980564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:50.980950 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:50.981393 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:51.023356 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:51.032354 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d2088bbb-6a02-4172-b579-cc60c78e381c tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.093370 May 10 15:05:51.032937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 227/432] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:50 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:51.472936 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:51.473556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:51.479817 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:51.480270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:51.481037 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:51.481503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:51.611805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:51.620186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:51.621940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:51.623134 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-31d6503f-7e6b-4a36-a887-179cb969d582 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.154160 May 10 15:05:51.623703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 206/433] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:51 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:51.891810 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:51.892682 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:51.901087 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:51.902082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:51.902640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:51.903093 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:52.028098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:52.035395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9ac12732-c2dc-47e4-9350-7619a5699ee4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.148699 May 10 15:05:52.035970 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 228/434] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:51 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:52.049101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:52.049762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:52.056750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:52.057196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:52.057952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:52.058401 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:52.088392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:52.088838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:52.089311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:52.132350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:52.139488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-40afeec9-2916-4d23-8714-cdfd3aa35645 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.094372 May 10 15:05:52.140051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 207/435] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:52 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:52.641959 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:52.642675 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:52.649073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:52.649527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:52.650290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:52.650755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:52.777738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:52.785690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:52.788017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:52.789190 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5de48a25-f060-499b-920b-a1814ad00e14 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.151170 May 10 15:05:52.789760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 229/436] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:52 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:53.052380 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:53.052933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:53.059280 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:53.059731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:53.060492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:53.060929 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:53.156147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:53.156765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:53.162604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:53.163095 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:53.163869 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:53.164340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:53.187070 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:53.194961 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d14325e4-6c9d-49f1-8990-407b3c69d570 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.146427 May 10 15:05:53.195129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:53.195435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:53.195548 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 208/437] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:53 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:53.195883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:53.237550 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:53.244776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-56061e23-ffa7-4695-bf05-7f15f37834db tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.092463 May 10 15:05:53.245351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 230/438] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:53 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:53.808254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:53.809003 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:53.816341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:53.816799 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:53.817584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:53.818201 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:53.955435 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:53.963170 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:53.964660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:53.965811 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-68e5bc98-3fc4-4d13-8ca0-42f258e2c3a1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.162212 May 10 15:05:53.966598 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 209/439] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:53 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:54.212287 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:54.213452 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:54.219433 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:54.220087 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:54.220855 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:54.221290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:54.262026 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:54.262895 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:54.269641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:54.270232 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:54.271513 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:54.273359 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:54.310965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:54.311415 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:54.311862 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lazy-loading 'fault' on Instance uuid 260d2d91-6d19-4624-9c5d-7d615badcae4 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:05:54.362495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd41b34f5b14ae0a0ebccec9d59944f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d3d605483a4228bd54793a27723c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:54.374588 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-604ef3d8-df28-4e45-b7ed-7d11cb08d110 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 200 len: 1303 microversion: 2.1 time: 0.116971 May 10 15:05:54.375492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 210/440] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:54 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:54.440673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:54.448614 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8c2de2da-11d8-4f4a-91d3-4567b809f169 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.240570 May 10 15:05:54.449201 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 231/441] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:54 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:54.984815 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:54.985761 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:54.992219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:54.992673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:54.993425 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:54.993903 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:55.141071 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:55.150483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:55.152084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:55.153255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d5a3b9fb-53c0-4658-94b1-5b01da7d91ce tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.172333 May 10 15:05:55.153821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 211/442] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:54 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:55.391263 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:55.391879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] [instance: 260d2d91-6d19-4624-9c5d-7d615badcae4] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:55.398344 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:55.398821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:55.399583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:55.400018 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:55.413191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] HTTP exception thrown: Instance 260d2d91-6d19-4624-9c5d-7d615badcae4 could not be found. May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Request method failure captured: May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 HTTP/1.1 May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien8Nc-H2dt9GDpBQE4zhkTbzO5JHuUtT8kwy-2K5tjlVkQCU9vTETbxy5zXrP0YRYO8_B795MXW6UHnwGcYm-aAGR4LV3M_SIbfYWoUwZej0AMctCrMJwtMLcZ16lXBNkFfTXKn-KaIGYpKcUfTWG2kDpzMHsVLJNfNa3TegDS1eB8Q May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: c9d3d605483a4228bd54793a27723c91 May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesActionsTest-156483215 May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:05:55.414864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c9d3d605483a4228bd54793a27723c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c9d3d605483a4228bd54793a27723c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c9d3d605483a4228bd54793a27723c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c9d3d605483a4228bd54793a27723c91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesActionsTest-156483215 May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: c9d3d605483a4228bd54793a27723c91 May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesActionsTest-156483215 May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesActionsTest-156483215-project May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 3bd41b34f5b14ae0a0ebccec9d59944f May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesActionsTest-156483215-project May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 260d2d91-6d19-4624-9c5d-7d615badcae4 could not be found. May 10 15:05:55.416406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '260d2d91-6d19-4624-9c5d-7d615badcae4'} May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260d2d91-6d19-4624-9c5d-7d615badcae4 could not be found. May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:05:55.417270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260d2d91-6d19-4624-9c5d-7d615badcae4 could not be found. May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260d2d91-6d19-4624-9c5d-7d615badcae4 could not be found. May 10 15:05:55.418737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:05:55.420048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] Returning 404 to user: Instance 260d2d91-6d19-4624-9c5d-7d615badcae4 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:05:55.420048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-21dd973d-3177-4e53-9277-6179572a0d18 tempest-VolumesActionsTest-156483215 tempest-VolumesActionsTest-156483215-project] 10.222.0.83 "GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4" status: 404 len: 111 microversion: 2.1 time: 0.028808 May 10 15:05:55.420048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 232/443] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:55 2022] GET /compute/v2.1/servers/260d2d91-6d19-4624-9c5d-7d615badcae4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:05:55.471254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:55.474723 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:55.482172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:55.482751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:55.483610 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:55.484119 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:55.614596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-57638ea8-dbe3-483f-8704-ae037b8d9816 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: .version_select at 0x7f7de0d7ac10>, body: {"keypair": {"name": "tempest-keypair-388513623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjwmlhk4qjOymAP6P/Au0bW+WTAdTjHJPN0TuXKZNpU19VgwiD45QWNq5Dewoj6IuSr6geUkFiO4tuEwZysu58wSRL/mylbkBoL3jx8eNhm22L9hO8fjrRU8jgIb0rbMQ=="}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:55.630298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-57638ea8-dbe3-483f-8704-ae037b8d9816 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:05:55.634341 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-57638ea8-dbe3-483f-8704-ae037b8d9816 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:05:55.656433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:55.662358 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-57638ea8-dbe3-483f-8704-ae037b8d9816 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051588 May 10 15:05:55.664103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 233/444] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:05:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:05:55.670739 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e5804ab2-5a22-43c8-b798-99d70ba4fbb5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.208812 May 10 15:05:55.671552 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 212/445] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:55 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:56.172380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:56.172998 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:56.179592 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:56.180052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:56.180826 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:56.181269 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:56.604517 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:56.612934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:56.614596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:56.615941 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-287c519d-3fdd-41cf-a38c-0c1e3029e297 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.447509 May 10 15:05:56.616577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 234/446] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:56 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:56.689123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:56.689742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:56.696137 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:56.697044 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:56.697823 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:56.698486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:56.856680 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:56.864095 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5ff024c7-9ac8-4a5c-95bb-e51cd6d8d8df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.179172 May 10 15:05:56.865650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 213/447] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:56 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:57.234509 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-313859450", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56419087-50d9-434c-b827-6ceec51e5c27"}], "security_groups": [{"name": "tempest-securitygroup--1480474791"}], "key_name": "tempest-keypair-388513623", "user_data": "}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:05:57.331177 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] validate_networks() for [('56419087-50d9-434c-b827-6ceec51e5c27', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:05:57.634558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:57.635200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:57.641065 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:57.641515 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:57.642286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:57.642749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:57.687591 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:05:57.688133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:05:57.688690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:05:57.689126 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:05:57.689535 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:05:57.699257 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:57.699704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:57.700504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:57.700938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:57.717570 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:05:57.721492 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:05:57.732393 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:05:57.734704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:05:57.770848 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:57.779295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:57.781748 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a6f02342-1a1f-4d55-bdad-0585acead6db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.551826 May 10 15:05:57.782504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 235/448] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:05:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:05:57.783948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:57.785203 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ae3a4edf-29fd-49ea-89f2-1002666e138e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.154974 May 10 15:05:57.785927 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 214/449] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:57 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:05:57.792010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0698d236-a93e-45b1-936e-8ce91e879147 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:57.792624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0698d236-a93e-45b1-936e-8ce91e879147 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:57.846193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0698d236-a93e-45b1-936e-8ce91e879147 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:57.853809 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0698d236-a93e-45b1-936e-8ce91e879147 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1240 microversion: 2.1 time: 0.065387 May 10 15:05:57.854593 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 236/450] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:57 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:57.883035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:57.883899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:57.889666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:57.890113 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:57.891095 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:57.891526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:58.034922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:58.042876 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2ccd9e9c-1668-4c8e-9ab4-3c2421256a79 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.164129 May 10 15:05:58.043444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 215/451] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:57 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:58.803638 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:58.804248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:58.810246 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:58.810724 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:58.811496 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:58.811930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:58.870766 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:58.871388 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:58.878293 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:58.878846 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:58.879619 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:58.880049 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:58.942026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:58.946957 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:58.950677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:58.952174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:58.953375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-94d3b521-bca3-4fc1-834a-43549156abde tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.153667 May 10 15:05:58.953944 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 237/452] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:58 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:05:58.954098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7063a7de-8087-414a-b469-c22e039adbe2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1244 microversion: 2.1 time: 0.087145 May 10 15:05:58.954602 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 216/453] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:58 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:05:59.059462 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:59.059993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:59.065839 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:59.066284 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:59.067072 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:59.067504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:59.199811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:05:59.207061 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2e1c41e8-2da6-48e5-9127-915105bba325 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.151425 May 10 15:05:59.207628 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 238/454] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:59 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:05:59.972932 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:59.974593 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:59.978372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:05:59.979613 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:05:59.985877 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:59.986624 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:59.988040 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:59.988481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:59.992426 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:59.993141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:05:59.993973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:05:59.994697 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:00.099898 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:00.110177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f3573e5b-4d9f-46ca-87a7-ace61e51d974 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1236 microversion: 2.1 time: 0.140945 May 10 15:06:00.111009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 217/455] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:05:59 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1236 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:00.189633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:00.197858 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:00.199640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:00.200973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-561beebb-ca9b-4125-a172-e12990170caf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.230238 May 10 15:06:00.201774 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 239/456] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:05:59 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:00.224342 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:00.227605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:00.235031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:00.235725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:00.236876 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:00.238366 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:00.369061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:00.376563 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b21aa999-82bc-4dc9-af54-b51dff865f12 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.156463 May 10 15:06:00.377132 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 218/457] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:00 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:01.134142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:01.134995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:01.148454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:01.152736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:01.152736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:01.152736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:01.219281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:01.220597 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:01.230593 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:01.231643 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:01.232589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:01.233176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:01.277111 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:01.286573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-21e98669-32ce-4edd-93a5-19edfb5285b8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1292 microversion: 2.1 time: 0.160378 May 10 15:06:01.298355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 240/458] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:01 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1292 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:01.393294 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:01.393912 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:01.400280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:01.400866 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:01.401830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:01.402511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:01.417548 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:01.426647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:01.428152 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:01.429877 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2bf4cf27-a93d-4f41-96a7-de5f6b2be8bb tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1745 microversion: 2.20 time: 0.214854 May 10 15:06:01.440657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 219/459] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:01 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1745 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:01.648549 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:01.657359 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3a2b2137-1269-4158-ba76-127000fea45e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.268094 May 10 15:06:01.668057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 241/460] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:01 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:02.311956 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:02.313685 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:02.332590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.336704 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:02.341269 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.342252 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:02.440549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:02.452092 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:02.453403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:02.457304 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-779e0e2d-c797-4754-8b25-a586f0319a7a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1298 microversion: 2.1 time: 0.156185 May 10 15:06:02.458091 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 220/461] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:02 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:02.474219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.474951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:02.476521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.477110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:02.676209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:02.677703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:02.686174 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.686775 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:02.687834 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.688349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:02.738732 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:02.758710 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:02.761591 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:02.768664 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3682a19a-d2c5-4264-bc3a-e24d6dfef0e9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1745 microversion: 2.20 time: 0.323904 May 10 15:06:02.787402 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 242/462] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:02 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1745 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:02.948710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:02.957498 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e03e9bbe-585b-4ca8-b286-dd4c72990e9b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1501 microversion: 2.1 time: 0.286387 May 10 15:06:02.961098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 221/463] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:02 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1501 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:02.978987 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d39b0d90-69e6-41a2-963f-22434151e931"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:02.981026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:02.990184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.991188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:02.992490 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:02.993374 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.040760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] HTTP exception thrown: Cannot 'attach_volume' instance 975ddad8-93eb-4cca-8d23-8de0f4637aea while it is in vm_state rescued May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Request method failure captured: May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: POST /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea/os-volume_attachments HTTP/1.1 May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 74 May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6lGI9oNd8c6_-54gyQ9qygpcyZVzBMrZGY5krraBhjSheFh_7mV52JYu0SKpGeICkITYh6gJdMWTAKknV_0ZJKuf7n29qMlO0glIoiz8wNfWZfusvZgEb5DfBbKDG_Kv4wARTGsyY81ZxDRPnvm-MT6v8Phg8x5BC5x59at72EcIM May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:06:03.043929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: e690e810cdb54431af33651d13272239 May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {"volumeAttachment": {"volumeId": "d39b0d90-69e6-41a2-963f-22434151e931"}} May 10 15:06:03.046459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Cannot 'attach_volume' instance 975ddad8-93eb-4cca-8d23-8de0f4637aea while it is in vm_state rescued May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'server_id': '975ddad8-93eb-4cca-8d23-8de0f4637aea', 'body': {'volumeAttachment': {'volumeId': 'd39b0d90-69e6-41a2-963f-22434151e931'}}} May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 975ddad8-93eb-4cca-8d23-8de0f4637aea in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:06:03.047625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 975ddad8-93eb-4cca-8d23-8de0f4637aea while it is in vm_state rescued May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:06:03.049601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:06:03.051668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:06:03.051668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:06:03.051668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 975ddad8-93eb-4cca-8d23-8de0f4637aea while it is in vm_state rescued May 10 15:06:03.051668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:06:03.053844 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Returning 409 to user: Cannot 'attach_volume' instance 975ddad8-93eb-4cca-8d23-8de0f4637aea while it is in vm_state rescued {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:06:03.055434 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-32b79dae-b2f4-451c-a71e-72837d34d08f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.082286 May 10 15:06:03.056307 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 243/464] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:06:02 2022] POST /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea/os-volume_attachments => generated 152 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 15:06:03.065532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9501c578-7ed4-494e-84d5-6a79a6bc1fd9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:03.066206 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9501c578-7ed4-494e-84d5-6a79a6bc1fd9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:03.073950 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9501c578-7ed4-494e-84d5-6a79a6bc1fd9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.074611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9501c578-7ed4-494e-84d5-6a79a6bc1fd9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.075525 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9501c578-7ed4-494e-84d5-6a79a6bc1fd9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.076055 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9501c578-7ed4-494e-84d5-6a79a6bc1fd9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.179463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9501c578-7ed4-494e-84d5-6a79a6bc1fd9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea/action" status: 202 len: 0 microversion: 2.1 time: 0.117062 May 10 15:06:03.181009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 222/465] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:06:03 2022] POST /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 15:06:03.195298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:03.196348 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:03.220248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.221385 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.223714 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.230103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.474995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:03.476529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:03.489882 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.490605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.495520 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.497336 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.738922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:03.739417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:03.749809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-73e9d961-a071-4555-b995-1c062f650297 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.279066 May 10 15:06:03.762080 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 223/466] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:03 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:03.763798 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e8cfdb4b-cb3d-4bf9-8389-2f63bf355820 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1509 microversion: 2.1 time: 0.576796 May 10 15:06:03.764643 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 244/467] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:03 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1509 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:03.805311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:03.807237 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:03.818283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.819142 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:03.820621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:03.821276 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:04.023187 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:04.033628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:04.035684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:04.037481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0a936c1e-ce63-4913-9fca-dcd856e61d1b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1745 microversion: 2.20 time: 0.247763 May 10 15:06:04.050092 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 224/468] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:03 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1745 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:04.772516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:04.773484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:04.787590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:04.790528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:04.796543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:04.797044 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:04.799331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:04.801454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:04.802650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:04.804351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:04.807214 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:04.807856 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:05.186155 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:05.199403 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8aae47a3-f8a1-43b2-b7b5-d2d27a944dd0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1509 microversion: 2.1 time: 0.420109 May 10 15:06:05.211099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 225/469] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:04 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:05.223536 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-4b93c8a8-18b6-4428-8b06-c22c77063ce0 req-34858d91-d5eb-4d5b-97d0-5b1584ac09d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aac7eb-fbec-4d86-82c9-1237542ad61a", "name": "network-vif-plugged", "status": "completed", "tag": "c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:05.260673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-4b93c8a8-18b6-4428-8b06-c22c77063ce0 req-34858d91-d5eb-4d5b-97d0-5b1584ac09d1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:05.261390 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-4b93c8a8-18b6-4428-8b06-c22c77063ce0 req-34858d91-d5eb-4d5b-97d0-5b1584ac09d1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:05.294302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-4b93c8a8-18b6-4428-8b06-c22c77063ce0 req-34858d91-d5eb-4d5b-97d0-5b1584ac09d1 service nova] Creating event network-vif-plugged:c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7 for instance a4aac7eb-fbec-4d86-82c9-1237542ad61a on hv-cinder-83962 May 10 15:06:05.305387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-4b93c8a8-18b6-4428-8b06-c22c77063ce0 req-34858d91-d5eb-4d5b-97d0-5b1584ac09d1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100390 May 10 15:06:05.326188 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 226/470] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:05.337595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:05.338762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:05.353110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:05.354139 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:05.360571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:05.362324 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:05.390440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:05.404283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9cae94e4-7723-41bf-b2c0-6ea9e52800de tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.638498 May 10 15:06:05.417663 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 245/471] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:04 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:05.648474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:05.676539 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:05.688542 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:05.691367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-78a5f3c4-e39e-447e-8e7e-fbd55a2bbefa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.362365 May 10 15:06:05.693092 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 227/472] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:05 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:05.773832 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-4cf80c6e-2845-44d9-bd6f-996611643040 req-650bcf3c-670d-4952-bac4-1d9a1c394dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d8853-d7e4-4507-b15b-6b9c0616ca94", "tag": "6f98d52c-c1aa-498b-8cab-ed2cad854767"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:05.794599 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-4cf80c6e-2845-44d9-bd6f-996611643040 req-650bcf3c-670d-4952-bac4-1d9a1c394dc2 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:05.800032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-4cf80c6e-2845-44d9-bd6f-996611643040 req-650bcf3c-670d-4952-bac4-1d9a1c394dc2 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:05.872854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-4cf80c6e-2845-44d9-bd6f-996611643040 req-650bcf3c-670d-4952-bac4-1d9a1c394dc2 service nova] Creating event network-changed:6f98d52c-c1aa-498b-8cab-ed2cad854767 for instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 on hv-cinder-83962 May 10 15:06:05.887448 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-4cf80c6e-2845-44d9-bd6f-996611643040 req-650bcf3c-670d-4952-bac4-1d9a1c394dc2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118890 May 10 15:06:05.888518 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 246/473] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:06.219190 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:06.220454 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:06.229137 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:06.229970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:06.231620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:06.232471 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:06.429994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:06.434142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:06.460770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:06.466696 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:06.467559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:06.470531 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:06.529414 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:06.544481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a44b08d4-aa7d-455c-a93a-ac1066367c25 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1509 microversion: 2.1 time: 0.328072 May 10 15:06:06.545297 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 228/474] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:06 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:06.716933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:06.717841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:06.725374 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:06.725722 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:06.726682 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:06.727285 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:06.745929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:06.757952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c3045539-8a82-4725-9404-f733c67dde13 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.335257 May 10 15:06:06.758905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 247/475] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:06 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:06.992797 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:07.003485 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:07.005244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:07.007233 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8816e9f6-164d-4a67-92a9-8276ae5db87c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.297120 May 10 15:06:07.007970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 229/476] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:06 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:07.567358 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:07.569466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:07.587559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:07.589848 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:07.593091 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:07.594414 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:07.793067 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:07.793067 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:07.797249 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:07.798523 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:07.799523 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:07.800626 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:08.009860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:08.020543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-954017a3-8648-4b51-9f9c-0bc2100becbc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1509 microversion: 2.1 time: 0.457752 May 10 15:06:08.033067 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 248/477] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:07 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:08.038363 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:08.045682 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:08.064961 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:08.065664 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:08.066482 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:08.066929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:08.153537 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:08.167723 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-61cb9bdc-835f-4637-ad62-39ca39007fd4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.386715 May 10 15:06:08.170286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 230/478] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:07 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:08.379128 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:08.392878 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:08.395521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:08.396808 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bdd54662-f113-408e-8a2b-22fadcd3ced7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.362806 May 10 15:06:08.398175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 249/479] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:08 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:09.042382 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:09.043445 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:09.077981 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:09.079111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:09.084173 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:09.087680 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:09.192383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:09.195860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:09.228358 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:09.229455 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:09.230985 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:09.239514 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:09.436875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:09.450124 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-59f417b6-c0df-44eb-9bdb-5b2eaa9c5373 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1509 microversion: 2.1 time: 0.415109 May 10 15:06:09.451331 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 231/480] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:09 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:09.458375 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:09.459386 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:09.470131 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:09.471023 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:09.472214 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:09.473180 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:09.562138 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:09.570236 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-36ecc7a8-4d94-4790-92b1-240e70545560 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.387753 May 10 15:06:09.570871 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 250/481] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:09 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:09.718652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:09.733786 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:09.735814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:09.737326 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-677afe1d-c46b-48d6-be19-c083c149d03f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.284606 May 10 15:06:09.754432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 232/482] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:09 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:10.470602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:10.472018 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:10.485205 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:10.493691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:10.495678 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:10.497140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:10.587805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:10.588547 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:10.601493 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:10.602042 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:10.604254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:10.605937 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:10.808670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:10.817812 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-06915c63-91fc-4161-8b21-1bed7faec5ce tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.234191 May 10 15:06:10.818759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 233/483] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:10 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:10.823751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:10.824758 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:10.833568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:10.837559 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:10.839047 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:10.839557 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:10.854250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:10.870651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9b140f76-29aa-4dae-810b-a511f5493fb3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1509 microversion: 2.1 time: 0.406227 May 10 15:06:10.872037 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 251/484] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:10 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:11.150022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:11.160381 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:11.161890 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:11.163670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6a567629-c0d9-442c-880c-25086e0890ac tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.343890 May 10 15:06:11.164614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 234/485] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:10 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:11.842607 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:11.844299 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:11.852151 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:11.852884 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:11.854051 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:11.854838 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:11.889011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:11.889944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:11.898486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:11.899097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:11.900205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:11.900751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:12.093725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:12.122609 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-66873a3b-6d2c-4c3a-a47b-6b39fe520be6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1515 microversion: 2.1 time: 0.218380 May 10 15:06:12.122609 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 235/486] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:11 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:12.181852 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:12.182835 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:12.188951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:12.192831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:12.195008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:12.195941 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:12.197534 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:12.209528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0d3656d7-6d1d-4093-8dfd-7c818ce0cdbc tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.375444 May 10 15:06:12.219150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 252/487] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:11 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:12.569257 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:12.608667 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:12.611710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:12.616226 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a8337aa4-f384-4b45-b214-ae044c01e404 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.437035 May 10 15:06:12.627975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 236/488] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:12 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:13.228100 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:13.228675 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:13.239437 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:13.240701 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:13.241996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:13.242558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:13.473558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:13.489091 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b597aec2-985f-4f1b-b094-b70a74084ed9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.264717 May 10 15:06:13.494493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 253/489] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:13 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:13.637468 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:13.638131 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:13.647896 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:13.648347 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:13.649134 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:13.649569 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:13.783173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0d0dab98-8ea2-4471-9148-7c13ef4396e7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'create', calling method: .version_select at 0x7f7de179fca0>, body: {"keypair": {"name": "tempest-keypair-1512138781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+//W3JqbnahFPlsX8UTSdA3OIXWW/yigKdJrZAqCctSVwATruBMHvDCW6rRT1ZTM700gha6z5/X74+5hfUzc+j/RQ1r5OphFD87rtDBca/Y5+NPKmUIewGZHBHGyu+2w=="}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:13.805471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-0d0dab98-8ea2-4471-9148-7c13ef4396e7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for project d851fe67b7e940f9b20979bdd619bf48. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:06:13.822305 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-0d0dab98-8ea2-4471-9148-7c13ef4396e7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for user e690e810cdb54431af33651d13272239 and project d851fe67b7e940f9b20979bdd619bf48. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:06:13.889255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:13.901740 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:13.903460 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:13.911119 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-84fe379a-2842-488d-9515-147613cd602d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.273315 May 10 15:06:13.924620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 237/490] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:13 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:13.931147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0d0dab98-8ea2-4471-9148-7c13ef4396e7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154056 May 10 15:06:13.932880 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 254/491] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:06:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:14.512011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:14.512970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:14.534460 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:14.538443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:14.543962 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:14.551479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:14.865514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:14.877517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-32098c64-8641-4564-a87f-5d0b176f5b87 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.373286 May 10 15:06:14.906892 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 238/492] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:14 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:14.929715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:14.930336 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:14.942072 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:14.942845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:14.944405 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:14.945012 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:15.331301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:15.345702 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:15.352264 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:15.361404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1df00c23-4f7f-40dc-9e52-05037a7facb2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.436067 May 10 15:06:15.362069 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 255/493] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:14 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:15.895844 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:15.896494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:15.923400 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:15.939181 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:15.940340 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:15.940792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:16.383398 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:16.384052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:16.388760 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:16.399669 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0a1337c3-623a-444f-82bd-25bc2775159b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.507560 May 10 15:06:16.416468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:16.417037 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 239/494] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:15 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:16.417924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:16.419111 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:16.419726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:16.478091 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1056446565", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb0f29c1-b758-46a7-96df-e2b922422879"}], "security_groups": [{"name": "tempest-securitygroup--2065583933"}], "key_name": "tempest-keypair-1512138781", "user_data": "}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:16.742345 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:16.754038 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:16.756053 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:16.758175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a7eb36bd-38c8-49d5-ac8a-bc92cea31c19 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.379117 May 10 15:06:16.769688 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 256/495] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:16 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:16.929213 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-8e1532c9-c9ea-42e6-99ad-08cf59aa0334 req-f052eab0-f16b-44ef-8f3f-739b8aeddd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527d8853-d7e4-4507-b15b-6b9c0616ca94", "name": "network-vif-plugged", "status": "completed", "tag": "6f98d52c-c1aa-498b-8cab-ed2cad854767"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:16.942025 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-8e1532c9-c9ea-42e6-99ad-08cf59aa0334 req-f052eab0-f16b-44ef-8f3f-739b8aeddd82 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:16.944749 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-8e1532c9-c9ea-42e6-99ad-08cf59aa0334 req-f052eab0-f16b-44ef-8f3f-739b8aeddd82 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:16.968188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-8e1532c9-c9ea-42e6-99ad-08cf59aa0334 req-f052eab0-f16b-44ef-8f3f-739b8aeddd82 service nova] Creating event network-vif-plugged:6f98d52c-c1aa-498b-8cab-ed2cad854767 for instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 on hv-cinder-83962 May 10 15:06:16.984399 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-8e1532c9-c9ea-42e6-99ad-08cf59aa0334 req-f052eab0-f16b-44ef-8f3f-739b8aeddd82 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059623 May 10 15:06:16.987154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 257/496] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:06:17.420790 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:17.421512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:17.435944 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:17.436716 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:17.437701 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:17.438307 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:17.481981 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] validate_networks() for [('bb0f29c1-b758-46a7-96df-e2b922422879', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:06:17.641708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:17.650963 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5b16cb6e-32b1-4771-8c95-62609f11851b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.234952 May 10 15:06:17.653428 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 258/497] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:17 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:17.778675 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:17.779692 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:17.786686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:17.787895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:17.789467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:17.790186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:17.974047 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:06:17.974787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:06:17.975009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:06:17.975411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:06:17.975820 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:06:17.976102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:17.989408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:17.990126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:17.991871 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:17.992429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:17.992731 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:17.994646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:17.996214 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-cd56ff74-4328-4f08-9df1-3cb0ff0d10d7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1740 microversion: 2.20 time: 0.222130 May 10 15:06:17.997518 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 259/498] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:17 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:18.013707 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for project d851fe67b7e940f9b20979bdd619bf48. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:06:18.018821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Getting quotas for user e690e810cdb54431af33651d13272239 and project d851fe67b7e940f9b20979bdd619bf48. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:06:18.036645 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:06:18.039333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:06:18.103688 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-24c837b7-9047-4070-98e8-5d2811f35e3a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.631462 May 10 15:06:18.109617 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 240/499] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:06:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:06:18.114912 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bb432a9a-8996-441f-a7f7-58caca5347c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:18.116264 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bb432a9a-8996-441f-a7f7-58caca5347c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:18.199301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bb432a9a-8996-441f-a7f7-58caca5347c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:18.207618 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bb432a9a-8996-441f-a7f7-58caca5347c5 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1246 microversion: 2.1 time: 0.096576 May 10 15:06:18.208510 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 260/500] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:18 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:18.670738 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:18.672686 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:18.681610 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:18.682719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:18.684217 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:18.685063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:18.876732 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:18.887564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b6099a6e-e119-48db-9bfc-d2f533ca17e7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1366 microversion: 2.1 time: 0.221411 May 10 15:06:18.888165 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 241/501] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:18 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:19.017672 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:19.018754 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:19.027619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:19.028020 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:19.028817 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:19.029264 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:19.183963 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:19.192320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:19.194421 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:19.195797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-17b532e7-d89a-45bf-8442-762cc48e1536 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1722 microversion: 2.20 time: 0.182502 May 10 15:06:19.196355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 261/502] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:19 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:19.231087 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:19.231737 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:19.238986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:19.239490 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:19.240267 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:19.240737 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:19.305686 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:19.313091 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3a16a668-1a56-4933-ba94-4c49984b31e8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1298 microversion: 2.1 time: 0.086105 May 10 15:06:19.313657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 242/503] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:19 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:19.905312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:19.906283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:19.919479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:19.919993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:19.920870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:19.921750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:20.086242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:20.094239 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8302afef-b8ee-4896-aa9f-6eb5f8fd5037 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1553 microversion: 2.1 time: 0.192841 May 10 15:06:20.095058 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 262/504] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:19 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:20.111412 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2a84b5b0-0f5b-4905-9883-49c85b9d16f1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:20.111943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2a84b5b0-0f5b-4905-9883-49c85b9d16f1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:20.118060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a84b5b0-0f5b-4905-9883-49c85b9d16f1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:20.118550 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a84b5b0-0f5b-4905-9883-49c85b9d16f1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:20.119404 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a84b5b0-0f5b-4905-9883-49c85b9d16f1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:20.119829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a84b5b0-0f5b-4905-9883-49c85b9d16f1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:20.200018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2a84b5b0-0f5b-4905-9883-49c85b9d16f1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092466 May 10 15:06:20.200614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 243/505] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:06:20 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:20.216249 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:20.217783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:20.224626 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:20.225075 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:20.225961 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:20.226436 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:20.332367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:20.333634 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:20.344297 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:20.345560 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:20.347323 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:20.348113 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:20.391133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:20.400549 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:20.409803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:20.413467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1776409f-870a-4816-a0fa-0e62f98963ff tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1722 microversion: 2.20 time: 0.201211 May 10 15:06:20.416113 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 263/506] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:20 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:20.518872 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:20.527593 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bbf888a9-9e88-4af5-a5f8-a68f86d689b4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1298 microversion: 2.1 time: 0.200018 May 10 15:06:20.535674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 244/507] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:20 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:21.433064 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:21.434723 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:21.441562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:21.442130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:21.443048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:21.443566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:21.544980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:21.547824 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:21.557324 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:21.558093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:21.558943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:21.559554 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:21.584613 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:21.598610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:21.600444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:21.601695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-65723233-b8a6-4b87-9597-2f13f90783b7 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1722 microversion: 2.20 time: 0.172539 May 10 15:06:21.602461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 264/508] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:21 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:21.661555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:21.669058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9ccfe359-f9c2-46ff-83fd-018b344b2b7d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1304 microversion: 2.1 time: 0.127909 May 10 15:06:21.669641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 245/509] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:21 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:21.721742 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-5e26ff00-e4a9-4a8e-90f8-1a352ad8bab4 req-4bf4edd7-c365-49fc-9cf2-c6b0db896b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d8853-d7e4-4507-b15b-6b9c0616ca94", "tag": "6f98d52c-c1aa-498b-8cab-ed2cad854767"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:21.731211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-5e26ff00-e4a9-4a8e-90f8-1a352ad8bab4 req-4bf4edd7-c365-49fc-9cf2-c6b0db896b6e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:21.731764 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-5e26ff00-e4a9-4a8e-90f8-1a352ad8bab4 req-4bf4edd7-c365-49fc-9cf2-c6b0db896b6e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:21.746840 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-5e26ff00-e4a9-4a8e-90f8-1a352ad8bab4 req-4bf4edd7-c365-49fc-9cf2-c6b0db896b6e service nova] Creating event network-changed:6f98d52c-c1aa-498b-8cab-ed2cad854767 for instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 on hv-cinder-83962 May 10 15:06:21.752767 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-5e26ff00-e4a9-4a8e-90f8-1a352ad8bab4 req-4bf4edd7-c365-49fc-9cf2-c6b0db896b6e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034223 May 10 15:06:21.753811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 265/510] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:22.622715 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:22.623343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:22.631662 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:22.632176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:22.633837 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:22.634569 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:22.686738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:22.695766 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:22.702353 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:22.703263 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:22.703962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:22.704417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:22.816853 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:22.828278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-39773c83-89bb-46a8-9fd4-cb54e006eed9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1304 microversion: 2.1 time: 0.145559 May 10 15:06:22.828600 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:22.831437 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 266/511] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:22 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:22.839560 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-9b87db97-c468-4d51-93fc-58224fd108db req-ae37320e-2c30-4e17-b548-1a8a1af73422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aac7eb-fbec-4d86-82c9-1237542ad61a", "name": "network-vif-unplugged", "status": "completed", "tag": "c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:22.848616 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:22.849510 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-9b87db97-c468-4d51-93fc-58224fd108db req-ae37320e-2c30-4e17-b548-1a8a1af73422 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:22.850060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-9b87db97-c468-4d51-93fc-58224fd108db req-ae37320e-2c30-4e17-b548-1a8a1af73422 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:22.852784 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:22.855066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-df4d6b14-eb5d-4c59-960c-f5810ba72fb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1722 microversion: 2.20 time: 0.237654 May 10 15:06:22.855875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 246/512] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:22 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:22.878429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-9b87db97-c468-4d51-93fc-58224fd108db req-ae37320e-2c30-4e17-b548-1a8a1af73422 service nova] Creating event network-vif-unplugged:c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7 for instance a4aac7eb-fbec-4d86-82c9-1237542ad61a on hv-cinder-83962 May 10 15:06:22.885705 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-9b87db97-c468-4d51-93fc-58224fd108db req-ae37320e-2c30-4e17-b548-1a8a1af73422 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052410 May 10 15:06:22.887229 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 267/513] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:23.846316 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:23.847603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:23.855129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:23.855828 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:23.856599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:23.857197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:23.875650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:23.876504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:23.883373 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:23.884187 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:23.885374 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:23.886027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:23.987287 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:24.021572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-77de91a3-277f-4277-b275-2b0f4f083d74 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1304 microversion: 2.1 time: 0.178578 May 10 15:06:24.025323 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 247/514] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:23 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:24.345200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:24.354867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:24.356892 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:24.358184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6c2b4fea-855e-4566-ae9e-b83b44d98cb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1725 microversion: 2.20 time: 0.488811 May 10 15:06:24.360130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 268/515] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:23 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1725 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:24.377432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f7cee0e9-233b-417d-b208-28fade953606 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2e4abd4-9651-4b9c-8b7d-0297ffbe004b"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:24.378968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f7cee0e9-233b-417d-b208-28fade953606 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:24.387046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7cee0e9-233b-417d-b208-28fade953606 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:24.387776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7cee0e9-233b-417d-b208-28fade953606 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:24.388652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7cee0e9-233b-417d-b208-28fade953606 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:24.389168 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7cee0e9-233b-417d-b208-28fade953606 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:24.743919 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f7cee0e9-233b-417d-b208-28fade953606 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.370170 May 10 15:06:24.744607 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 248/516] 10.222.0.83 () {62 vars in 1363 bytes} [Tue May 10 15:06:24 2022] POST /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments => generated 188 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:06:24.901042 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bca2a1df-fa26-478a-8539-5b963595dec6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:24.901525 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bca2a1df-fa26-478a-8539-5b963595dec6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:24.919592 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bca2a1df-fa26-478a-8539-5b963595dec6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:24.920475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bca2a1df-fa26-478a-8539-5b963595dec6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:24.923997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bca2a1df-fa26-478a-8539-5b963595dec6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:24.924522 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bca2a1df-fa26-478a-8539-5b963595dec6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:25.052009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:25.052589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:25.097209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:25.097673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:25.098522 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:25.098968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:25.239942 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bca2a1df-fa26-478a-8539-5b963595dec6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/action" status: 202 len: 0 microversion: 2.20 time: 0.349150 May 10 15:06:25.241352 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 269/517] 10.222.0.83 () {62 vars in 1318 bytes} [Tue May 10 15:06:24 2022] POST /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 15:06:25.253234 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:25.253921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:25.267027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:25.268037 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:25.271492 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:25.272338 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:25.307995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:25.317457 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-656d715c-03b7-4de8-9b38-dc079b51cd20 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.269686 May 10 15:06:25.322028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 249/518] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:25 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:25.561788 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:25.579362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:25.580916 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:25.598986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a87650a6-a96b-422d-8add-70fad49189ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1751 microversion: 2.20 time: 0.336452 May 10 15:06:25.599909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 270/519] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:25 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1751 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:25.896812 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-7dd9fc93-5dd8-4eb0-bfbf-5447d056a3b6 req-7d4b4928-2146-43c9-b40e-e04df0cba6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05c7bca-c0fc-42f3-8561-19dd08b84581", "tag": "ea78e5d2-ebba-4237-9401-0a7bce6e10b9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:25.940805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-7dd9fc93-5dd8-4eb0-bfbf-5447d056a3b6 req-7d4b4928-2146-43c9-b40e-e04df0cba6de service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:25.941265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-7dd9fc93-5dd8-4eb0-bfbf-5447d056a3b6 req-7d4b4928-2146-43c9-b40e-e04df0cba6de service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:25.964733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-7dd9fc93-5dd8-4eb0-bfbf-5447d056a3b6 req-7d4b4928-2146-43c9-b40e-e04df0cba6de service nova] Creating event network-changed:ea78e5d2-ebba-4237-9401-0a7bce6e10b9 for instance b05c7bca-c0fc-42f3-8561-19dd08b84581 on hv-cinder-83962 May 10 15:06:25.973016 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-7dd9fc93-5dd8-4eb0-bfbf-5447d056a3b6 req-7d4b4928-2146-43c9-b40e-e04df0cba6de service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083375 May 10 15:06:25.978002 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 250/520] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:26.342590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:26.342993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:26.349084 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:26.349411 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:26.350195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:26.350726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:26.541539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:26.550370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-753da4f7-5bbf-4787-b13c-3637b0da50d0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.213422 May 10 15:06:26.551921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 271/521] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:26 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:06:26.619796 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:26.621180 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:26.636594 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:26.637336 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:26.638152 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:26.638799 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:26.842347 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:26.851368 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:26.852902 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:26.854058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c3d0d3ff-1247-4146-afc0-638ea9338d1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1751 microversion: 2.20 time: 0.239339 May 10 15:06:26.854662 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 251/522] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:26 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:27.571204 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:27.571826 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:27.578135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:27.579124 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:27.580469 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:27.580907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:27.714755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:27.722516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ce50a956-e132-494e-b34e-931fab713ce4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.157642 May 10 15:06:27.723268 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 272/523] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:27 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:27.873058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:27.873733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:27.879665 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:27.880061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:27.880869 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:27.881481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:28.016794 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:28.027082 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:28.029026 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:28.030195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f9552297-c72b-4131-a380-300e2c2eb141 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1751 microversion: 2.20 time: 0.161441 May 10 15:06:28.030780 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 252/524] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:27 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:28.739060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:28.739680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:28.746737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:28.747315 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:28.748261 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:28.748708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:28.880852 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:28.887989 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4eb03c3f-e8d4-408f-874b-8e7746551b36 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.152800 May 10 15:06:28.888558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 273/525] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:28 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:29.049071 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:29.049605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:29.056855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:29.057320 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:29.058092 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:29.058578 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:29.192474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:29.202361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:29.203974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:29.206161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6a2a23f7-4207-44ad-8865-3a5256851dfc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1753 microversion: 2.20 time: 0.161057 May 10 15:06:29.206921 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 253/526] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:29 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:29.904682 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:29.905334 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:29.912864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:29.913867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:29.914699 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:29.915142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:30.224407 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:30.224963 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:30.231350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:30.231805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:30.232590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:30.233029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:30.348569 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:30.358777 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-752fd19b-aca5-4f96-9f60-c97fe67aeffa tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.457928 May 10 15:06:30.362234 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 274/527] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:29 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:30.384474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:30.392834 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:30.394340 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:30.395550 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7a407e3f-541e-4be1-ba35-086af9562d7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.175240 May 10 15:06:30.396094 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 254/528] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:30 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:31.380186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:31.382579 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:31.390616 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:31.391367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:31.392640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:31.393271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:31.415693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:31.416308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:31.429011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:31.431589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:31.432934 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:31.439068 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:31.562129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:31.573303 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ecbee69f-ae0b-48b0-8bb4-6d7467359cc1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.198635 May 10 15:06:31.573897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 275/529] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:31 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:31.706265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:31.716719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:31.718548 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:31.719900 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-54fee4a8-c4c7-4bbb-bee8-7ad3f59f8d26 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.309426 May 10 15:06:31.720615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 255/530] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:31 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:32.590008 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:32.590584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:32.596558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:32.597013 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:32.597782 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:32.598218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:32.737976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:32.738626 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:32.746050 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:32.746997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:32.748002 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:32.748681 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:32.763997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:32.781380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0330efbe-3dfd-4cfd-9e2f-6cc032c002df tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.195118 May 10 15:06:32.782270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 276/531] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:32 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:32.875925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-be88dae0-6243-402e-91bc-624a79e2867d req-992ca279-c83c-408d-91d0-133114baa307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05c7bca-c0fc-42f3-8561-19dd08b84581", "name": "network-vif-plugged", "status": "completed", "tag": "ea78e5d2-ebba-4237-9401-0a7bce6e10b9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:32.890821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-be88dae0-6243-402e-91bc-624a79e2867d req-992ca279-c83c-408d-91d0-133114baa307 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:32.892017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-be88dae0-6243-402e-91bc-624a79e2867d req-992ca279-c83c-408d-91d0-133114baa307 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:32.905398 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-be88dae0-6243-402e-91bc-624a79e2867d req-992ca279-c83c-408d-91d0-133114baa307 service nova] Creating event network-vif-plugged:ea78e5d2-ebba-4237-9401-0a7bce6e10b9 for instance b05c7bca-c0fc-42f3-8561-19dd08b84581 on hv-cinder-83962 May 10 15:06:32.926047 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-be88dae0-6243-402e-91bc-624a79e2867d req-992ca279-c83c-408d-91d0-133114baa307 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053889 May 10 15:06:32.927268 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 277/532] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:32.939485 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:32.947728 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:32.949246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:32.950470 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4bd28ab4-0920-4244-abe0-1c49d7f8acb3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.216518 May 10 15:06:32.951035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 256/533] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:32 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:33.801430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:33.802129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:33.810172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:33.810762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:33.811769 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:33.812290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:33.951699 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:33.959107 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3534c32d-9979-4f91-bf04-62dfeb76bccf tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.161743 May 10 15:06:33.959685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 278/534] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:33 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:33.969099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:33.969711 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:33.976481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:33.976925 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:33.977687 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:33.978120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:34.106241 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:34.115432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:34.117650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:34.118896 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-dd5fd8c3-f5bf-4e4f-a47b-96f377afaff6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.153645 May 10 15:06:34.119472 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 257/535] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:33 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:34.976720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:34.977589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:34.984129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:34.984595 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:34.985384 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:34.985814 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:35.116141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:35.124211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3859afa3-2b40-4e92-8b8b-0cb55b07b94e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.151828 May 10 15:06:35.124797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 279/536] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:34 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:35.137270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:35.138812 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:35.151900 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:35.152371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:35.153167 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:35.153606 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:35.315274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:35.327439 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:35.329037 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:35.330568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1c174795-9adf-4444-992f-90016faecc16 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.197299 May 10 15:06:35.331343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 258/537] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:35 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:36.141624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:36.143059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:36.149293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:36.149750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:36.150579 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:36.151026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:36.282494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:36.291284 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-87b0a403-50af-49d7-bf11-a91d4784bece tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.154081 May 10 15:06:36.292007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 280/538] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:36 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:36.349709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:36.350314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:36.357443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:36.357887 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:36.358691 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:36.359130 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:36.495683 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:36.504646 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:36.506179 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:36.507413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c8c8f074-cfc1-4b8a-ac4c-ff1d81aa4ece tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.161669 May 10 15:06:36.507974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 259/539] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:36 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:37.308114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:37.308669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:37.314969 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:37.315419 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:37.316194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:37.316624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:37.456285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:37.464420 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7a70d7bc-7d2c-49a7-97c2-d60ca1bb757a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.160554 May 10 15:06:37.465184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 281/540] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:37 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:37.526517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:37.527150 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:37.533519 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:37.533972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:37.534782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:37.535221 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:37.665303 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:37.674569 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:37.676074 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:37.677266 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2ecc2f43-3425-4ef9-8644-10feb245426b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.155246 May 10 15:06:37.677823 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 260/541] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:37 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:38.481428 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:38.482033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:38.488026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:38.488481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:38.489246 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:38.489687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:38.629322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:38.637528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-555ab2cb-e717-464e-afb6-a980506221fc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.160178 May 10 15:06:38.638372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 282/542] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:38 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:38.695933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:38.696554 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:38.703225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:38.703683 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:38.704463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:38.704908 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:38.845796 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:38.855828 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:38.857362 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:38.858562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7030057c-db42-4d44-8706-dda0c19a3be2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.166998 May 10 15:06:38.859128 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 261/543] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:38 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:39.654952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:39.655564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:39.661600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:39.662056 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:39.662915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:39.663874 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:39.797256 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:39.805003 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-265a6629-3b86-495b-8357-165f1526acf2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.153897 May 10 15:06:39.805780 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 283/544] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:39 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:39.877449 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:39.878131 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:39.891831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:39.891831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:39.891831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:39.891831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:40.029242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:40.038768 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:40.040280 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:40.041431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f3d558d5-2dca-4de0-ae7e-db3f99ba69f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.167997 May 10 15:06:40.042174 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 262/545] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:39 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:40.156115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:06:40.156380 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Tue May 10 15:06:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:06:40.821412 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:40.822033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:40.827850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:40.828304 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:40.829076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:40.829515 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:40.965843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:40.973537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-50fad268-2247-45b6-ad89-a73ec4ca96d9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.156339 May 10 15:06:40.974380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 284/546] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:40 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:41.061097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:41.061693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:41.068907 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:41.070130 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:41.071087 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:41.071531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:41.207699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:41.216136 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:41.217637 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:41.218803 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-da5beaf2-e790-4c2d-93e8-bf803cb92f69 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.161619 May 10 15:06:41.219360 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 263/547] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:41 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:41.991272 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:41.991888 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:41.998273 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:41.998992 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:41.999820 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:42.000264 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:42.159545 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:42.167917 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-866c9cbf-cde3-4f5a-9c48-6ae0de829da8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.180022 May 10 15:06:42.177570 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 285/548] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:41 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:42.237672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:42.239265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:42.247438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:42.247889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:42.248865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:42.249315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:42.404789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:42.413329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:42.415950 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:42.417422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5ba5d77d-bb59-4f98-b291-5032909c415f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.184246 May 10 15:06:42.418133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 264/549] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:42 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:43.185100 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:43.185728 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:43.191634 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:43.192086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:43.192850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:43.193287 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:43.322810 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:43.330012 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c08d45bc-79e0-4724-b576-891642cdd183 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.148842 May 10 15:06:43.330609 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 286/550] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:43 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:43.436587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:43.437196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:43.443425 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:43.443875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:43.444636 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:43.445075 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:43.570983 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:43.579152 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:43.580681 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:43.581831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b50153f9-8e6a-48d9-8368-e5ae8ab5ab75 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.149108 May 10 15:06:43.582412 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 265/551] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:43 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:44.347138 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:44.347769 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:44.353636 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:44.354079 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:44.354864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:44.355297 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:44.484803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:44.492660 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d6388832-5cc1-46ea-9ba6-dd5893b520bd tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.149360 May 10 15:06:44.493226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 287/552] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:44 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:44.599673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:44.601414 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:44.607745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:44.608195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:44.608967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:44.609438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:44.739220 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:44.748436 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:44.749946 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:44.751130 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8c034fe3-f00f-4258-82eb-8b6057f24329 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.155432 May 10 15:06:44.751698 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 266/553] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:44 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:45.514979 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:45.515585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:45.521489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:45.521939 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:45.523395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:45.523845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:45.651228 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:45.658495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e71b09c9-679a-4ad0-a9a7-88c65e04d45a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.147319 May 10 15:06:45.659144 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 288/554] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:45 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:45.768901 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:45.769519 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:45.775760 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:45.776200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:45.776954 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:45.777385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:45.900976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:45.909452 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:45.910991 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:45.912217 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c2d59c17-410b-42f6-b31e-9184a27254af tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.147148 May 10 15:06:45.912826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 267/555] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:45 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:06:46.676506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:46.677639 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:46.685246 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:46.685693 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:46.686977 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:46.687651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:46.820241 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:46.827694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7dc0afca-094e-4a28-a22e-3aabbef8297d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1372 microversion: 2.1 time: 0.155440 May 10 15:06:46.828269 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 289/556] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:46 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:46.932390 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:46.933006 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:46.939516 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:46.940008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:46.940779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:46.941216 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:47.083290 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:47.092134 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:47.093632 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:47.094828 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-91b0ad45-392d-46c4-b4ab-75627e800f8f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.167919 May 10 15:06:47.095391 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 268/557] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:46 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:47.844907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:47.845625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:47.851445 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:47.851902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:47.852680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:47.853177 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:47.981470 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:47.989061 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-96628900-18d8-4c52-8426-0119ff68fe88 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1566 microversion: 2.1 time: 0.148007 May 10 15:06:47.989667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 290/558] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:06:47 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:06:48.005819 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-da0b350b-e73b-462f-8eb6-1a0c2bc9d086 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:48.006358 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-da0b350b-e73b-462f-8eb6-1a0c2bc9d086 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:48.013260 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da0b350b-e73b-462f-8eb6-1a0c2bc9d086 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:48.013710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da0b350b-e73b-462f-8eb6-1a0c2bc9d086 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:48.014695 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da0b350b-e73b-462f-8eb6-1a0c2bc9d086 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:48.015151 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-da0b350b-e73b-462f-8eb6-1a0c2bc9d086 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:48.093445 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-da0b350b-e73b-462f-8eb6-1a0c2bc9d086 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091394 May 10 15:06:48.094077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 269/559] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:06:48 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:06:48.115433 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:48.115433 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:48.122849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:48.123295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:48.124248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:48.124688 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:48.265657 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:48.274047 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:48.275981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:48.277261 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8beee41f-2f85-42fc-ad3d-c4bbbb55250e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.166477 May 10 15:06:48.278219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 291/560] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:48 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:49.103502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-83a165a9-1ddd-4c08-9562-f8ddf52e606e req-4fe21a89-8bdf-4da2-a32a-c1a329985268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05c7bca-c0fc-42f3-8561-19dd08b84581", "tag": "ea78e5d2-ebba-4237-9401-0a7bce6e10b9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:06:49.111392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-83a165a9-1ddd-4c08-9562-f8ddf52e606e req-4fe21a89-8bdf-4da2-a32a-c1a329985268 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:49.111837 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-83a165a9-1ddd-4c08-9562-f8ddf52e606e req-4fe21a89-8bdf-4da2-a32a-c1a329985268 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:49.123616 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-83a165a9-1ddd-4c08-9562-f8ddf52e606e req-4fe21a89-8bdf-4da2-a32a-c1a329985268 service nova] Creating event network-changed:ea78e5d2-ebba-4237-9401-0a7bce6e10b9 for instance b05c7bca-c0fc-42f3-8561-19dd08b84581 on hv-cinder-83962 May 10 15:06:49.128603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-83a165a9-1ddd-4c08-9562-f8ddf52e606e req-4fe21a89-8bdf-4da2-a32a-c1a329985268 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029807 May 10 15:06:49.130020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 270/561] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:06:49.295814 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:49.296442 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:49.302563 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:49.303021 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:49.303886 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:49.304329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:49.499372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:49.508416 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:49.509924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:49.511117 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-610db4d0-2aee-4ce5-a90b-ef77c7089241 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.219364 May 10 15:06:49.511690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 292/562] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:49 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:50.529841 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:50.530568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:50.537122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:50.537519 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:50.539176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:50.539621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:50.671341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:50.680034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:50.681535 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:50.682719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cf12da2b-42aa-411f-8caa-87dce636578d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.157176 May 10 15:06:50.683277 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 271/563] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:50 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:51.701029 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:51.701556 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:51.707440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:51.707890 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:51.708655 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:51.709088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:51.831749 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:51.840029 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:51.841527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:51.842706 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-57b16bcd-eaeb-4b53-9dd5-e8af5a7eaf3a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.145664 May 10 15:06:51.843274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 293/564] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:51 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:52.860694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:52.861320 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:52.867636 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:52.868092 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:52.868861 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:52.869301 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:52.996975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:53.005057 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:53.006580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:53.008254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-96e05e3c-037f-4d21-a697-727f71cc99f8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.151575 May 10 15:06:53.008816 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 272/565] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:52 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:54.026915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:54.027536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:54.033356 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:54.033811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:54.034615 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:54.035057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:54.168955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:54.177264 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:54.178741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:54.179879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7e064fc8-5d20-402a-9396-1f2ddb09de6c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.157393 May 10 15:06:54.180443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 294/566] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:54 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:55.197855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:55.198506 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:55.204857 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:55.205312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:55.206078 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:55.206543 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:55.342579 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:55.351121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:55.352640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:55.353789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d8df2329-8c9b-443f-b33f-73a9c6beac93 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.159740 May 10 15:06:55.354353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 273/567] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:55 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:56.372321 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:56.372926 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:56.378750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:56.379195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:56.379955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:56.380381 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:56.508984 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:56.517054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:56.518572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:56.519714 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-df4f7dbb-5aa2-4b6f-9f74-a17555a4dd43 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.151518 May 10 15:06:56.520278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 295/568] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:56 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:57.538118 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:57.538764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:57.545015 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:57.545464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:57.546265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:57.546719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:57.670365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:57.678491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:57.680564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:57.681711 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6487d4d6-ceb4-4a19-a755-1755d14c4eda tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.147465 May 10 15:06:57.682274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 274/569] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:57 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:58.700231 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:58.700833 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:58.706718 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:58.707165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:58.707919 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:58.708351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:58.836694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:58.844923 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:58.846449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:06:58.847603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6290fa00-6320-4516-b893-ef45f2b7c354 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.151301 May 10 15:06:58.848170 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 296/570] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:58 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:06:59.865574 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:06:59.866186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:06:59.872748 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:59.873195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:59.873956 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:06:59.874415 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:06:59.998446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:00.006685 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:00.008225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:00.009422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c77b382a-5ca4-4e21-b312-a93ca502a6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.147730 May 10 15:07:00.009987 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 275/571] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:06:59 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:07:01.027892 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:01.028499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:01.034312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:01.034793 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:01.035544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:01.035975 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:01.162537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:01.170776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:01.172214 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:01.173365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8982210d-1c75-40e7-936f-5e8b54268849 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.149831 May 10 15:07:01.173929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 297/572] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:07:01 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:07:02.192315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:02.192855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:02.199656 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:02.200103 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:02.200872 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:02.201309 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:02.330355 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:02.338596 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:02.340102 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:02.341248 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-528db313-86e1-4542-8abe-66b26fb46fe0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.153121 May 10 15:07:02.341816 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 276/573] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:07:02 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:07:03.359435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:03.360043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:03.365727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:03.366186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:03.366991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:03.367420 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:03.565144 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:03.574960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:03.576485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:03.577648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a46c2613-c14d-4e6a-b2d0-90fd42596d80 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.222113 May 10 15:07:03.578207 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 298/574] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:07:03 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:07:03.884185 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-5045ecba-19cc-4391-b74f-d749dcdea195 req-8a1cf8c4-6d22-4b70-b67c-db20290463e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aac7eb-fbec-4d86-82c9-1237542ad61a", "name": "network-vif-plugged", "status": "completed", "tag": "c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:03.896990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-5045ecba-19cc-4391-b74f-d749dcdea195 req-8a1cf8c4-6d22-4b70-b67c-db20290463e4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:03.897446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-5045ecba-19cc-4391-b74f-d749dcdea195 req-8a1cf8c4-6d22-4b70-b67c-db20290463e4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:03.910694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-5045ecba-19cc-4391-b74f-d749dcdea195 req-8a1cf8c4-6d22-4b70-b67c-db20290463e4 service nova] Creating event network-vif-plugged:c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7 for instance a4aac7eb-fbec-4d86-82c9-1237542ad61a on hv-cinder-83962 May 10 15:07:03.918418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-5045ecba-19cc-4391-b74f-d749dcdea195 req-8a1cf8c4-6d22-4b70-b67c-db20290463e4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039673 May 10 15:07:03.919253 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 277/575] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:07:04.598802 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:04.599528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:04.606053 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:04.606677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:04.607707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:04.608567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:04.752999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:04.761640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:04.763174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:04.764325 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b5f728ab-d75c-4c91-8f0e-07f586d94e5f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.169867 May 10 15:07:04.764883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 299/576] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:07:04 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:07:05.784417 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:05.785109 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:05.792403 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:05.792862 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:05.793866 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:05.794416 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:05.919933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:05.928226 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:05.930278 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:05.931464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f069db76-9694-4c78-9f27-651b06ad1fa2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.152166 May 10 15:07:05.932024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 278/577] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:07:05 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:07:06.949995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:06.950872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:06.957577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:06.958105 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:06.959081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:06.959590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:07.092104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:07.100799 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:07.102405 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:07.103640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5e318bcc-e5f1-4b30-8cb0-93fa6639b51b tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1809 microversion: 2.20 time: 0.157903 May 10 15:07:07.104308 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 300/578] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:07:06 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:07:08.121186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:08.122047 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:08.128383 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:08.128824 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:08.129585 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:08.130015 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:08.257528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:08.265774 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:08.267293 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:08.268444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-115c4684-d610-4f06-a86c-c17694465469 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1796 microversion: 2.20 time: 0.151191 May 10 15:07:08.269021 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 279/579] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:07:08 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1796 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:07:29.893147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2f1850fa-08ec-4c6c-94dc-e6325b01e3c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:29.893724 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2f1850fa-08ec-4c6c-94dc-e6325b01e3c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:29.899548 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1850fa-08ec-4c6c-94dc-e6325b01e3c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:29.899987 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1850fa-08ec-4c6c-94dc-e6325b01e3c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:29.900739 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1850fa-08ec-4c6c-94dc-e6325b01e3c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:29.901168 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1850fa-08ec-4c6c-94dc-e6325b01e3c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:29.923627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2f1850fa-08ec-4c6c-94dc-e6325b01e3c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94/ips" status: 200 len: 146 microversion: 2.1 time: 0.034259 May 10 15:07:29.924199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 301/580] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:07:29 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94/ips => generated 146 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:29.935017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a24f4754-fefd-446e-b59c-eaab935acdfc"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:29.936081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:29.942383 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:29.942864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:29.943623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:29.944059 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:30.022329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Invalid volume: volume a24f4754-fefd-446e-b59c-eaab935acdfc is already attached to instances: 11828dfd-b035-4c1b-a5b7-61553717870c May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: POST /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94/os-volume_attachments HTTP/1.1 May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 74 May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:07:30.024595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {"volumeAttachment": {"volumeId": "a24f4754-fefd-446e-b59c-eaab935acdfc"}} May 10 15:07:30.026162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Invalid volume: volume a24f4754-fefd-446e-b59c-eaab935acdfc is already attached to instances: 11828dfd-b035-4c1b-a5b7-61553717870c May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'server_id': '527d8853-d7e4-4507-b15b-6b9c0616ca94', 'body': {'volumeAttachment': {'volumeId': 'a24f4754-fefd-446e-b59c-eaab935acdfc'}}} May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a24f4754-fefd-446e-b59c-eaab935acdfc is already attached to instances: 11828dfd-b035-4c1b-a5b7-61553717870c May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:07:30.027064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a24f4754-fefd-446e-b59c-eaab935acdfc is already attached to instances: 11828dfd-b035-4c1b-a5b7-61553717870c May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:30.028649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a24f4754-fefd-446e-b59c-eaab935acdfc is already attached to instances: 11828dfd-b035-4c1b-a5b7-61553717870c May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 400 to user: Invalid volume: volume a24f4754-fefd-446e-b59c-eaab935acdfc is already attached to instances: 11828dfd-b035-4c1b-a5b7-61553717870c {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6fc29dec-4330-4b15-9b82-1cb5b000ba1d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095588 May 10 15:07:30.030209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 280/581] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:07:29 2022] POST /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 15:07:30.034784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:30.035291 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:30.041275 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:30.041726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:30.042521 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:30.042964 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:30.066943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:07:30.139390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2c4e1c46-ec20-478c-b771-e1c2fc622a5b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 204 len: 0 microversion: 2.1 time: 0.108195 May 10 15:07:30.139960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 302/582] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:07:30 2022] DELETE /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:07:30.148410 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:30.149134 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:30.155628 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:30.156167 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:30.157028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:30.157483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:30.282377 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:30.290204 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-88d37b5b-e33e-461c-8580-f58c0f25fc8b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1677 microversion: 2.1 time: 0.145248 May 10 15:07:30.290820 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 281/583] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:30 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:31.309527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:31.310160 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:31.316104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:31.316617 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:31.317377 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:31.317809 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:31.443210 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:31.451040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-63dcbfe8-564a-4226-9cee-ada8267e700e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1677 microversion: 2.1 time: 0.146380 May 10 15:07:31.451607 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 303/584] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:31 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:32.468821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:32.469438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:32.475283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:32.475736 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:32.476509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:32.476945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:32.603562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:32.610892 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3c897ab0-dd90-45a4-977f-db868cb8cb12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1677 microversion: 2.1 time: 0.146110 May 10 15:07:32.611503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 282/585] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:32 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:33.338312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-0d386e0a-e397-497f-b158-9c493e1eb923 req-5f055251-aeb8-4b1f-b8cc-91f7647f7834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527d8853-d7e4-4507-b15b-6b9c0616ca94", "name": "network-vif-deleted", "tag": "6f98d52c-c1aa-498b-8cab-ed2cad854767"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:33.345796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-0d386e0a-e397-497f-b158-9c493e1eb923 req-5f055251-aeb8-4b1f-b8cc-91f7647f7834 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:33.346243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-0d386e0a-e397-497f-b158-9c493e1eb923 req-5f055251-aeb8-4b1f-b8cc-91f7647f7834 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:33.358537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-0d386e0a-e397-497f-b158-9c493e1eb923 req-5f055251-aeb8-4b1f-b8cc-91f7647f7834 service nova] Creating event network-vif-deleted:6f98d52c-c1aa-498b-8cab-ed2cad854767 for instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 on hv-cinder-83962 May 10 15:07:33.363700 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-0d386e0a-e397-497f-b158-9c493e1eb923 req-5f055251-aeb8-4b1f-b8cc-91f7647f7834 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029983 May 10 15:07:33.367248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 304/586] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:33.628448 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:33.629059 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:33.636318 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:33.637013 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:33.637980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:33.638610 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:33.669927 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:33.670320 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:33.671500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lazy-loading 'fault' on Instance uuid 527d8853-d7e4-4507-b15b-6b9c0616ca94 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:07:33.712824 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:33.720558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1e8788b8-d9f4-41a2-ab7b-57e21a5f301d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 200 len: 1330 microversion: 2.1 time: 0.096158 May 10 15:07:33.729996 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 283/587] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:33 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:34.737689 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:34.738529 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:34.744734 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:34.745374 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:34.745958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:34.746407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:34.760567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 HTTP/1.1 May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:07:34.762196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:07:34.763752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '527d8853-d7e4-4507-b15b-6b9c0616ca94'} May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:07:34.764824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:07:34.766060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:34.767661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:07:34.767661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5f66a8b2-b4c8-46d7-a613-89852de3bae2 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 404 len: 111 microversion: 2.1 time: 0.030254 May 10 15:07:34.767661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 305/588] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:34 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:07:34.772327 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-179dc8ef-5ba4-4132-9273-4cfcf8bd9d05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '.version_select at 0x7f7de0c1cee0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:34.794209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-179dc8ef-5ba4-4132-9273-4cfcf8bd9d05 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388513623" status: 202 len: 0 microversion: 2.1 time: 0.025537 May 10 15:07:34.794846 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 284/589] 10.222.0.83 () {58 vars in 1217 bytes} [Tue May 10 15:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388513623 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:07:35.750015 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:35.750552 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:35.756416 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:35.756868 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:35.757750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:35.758850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:36.039498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lazy-loading 'services' on Instance uuid 11828dfd-b035-4c1b-a5b7-61553717870c {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:07:36.149408 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6acc38f3-3b49-4409-a191-7fa51098da06 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments/a24f4754-fefd-446e-b59c-eaab935acdfc" status: 202 len: 0 microversion: 2.1 time: 0.403491 May 10 15:07:36.149993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 306/590] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:07:35 2022] DELETE /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments/a24f4754-fefd-446e-b59c-eaab935acdfc => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:07:36.158352 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a3923077-2726-48dd-9123-752186e9e458 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:36.159294 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a3923077-2726-48dd-9123-752186e9e458 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:36.166584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3923077-2726-48dd-9123-752186e9e458 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:36.167039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3923077-2726-48dd-9123-752186e9e458 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:36.167801 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3923077-2726-48dd-9123-752186e9e458 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:36.168237 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3923077-2726-48dd-9123-752186e9e458 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:36.196962 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a3923077-2726-48dd-9123-752186e9e458 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 May 10 15:07:36.197453 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 285/591] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:07:36 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:37.209430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dd13eb4a-28e7-45c9-ba10-31cf0dadbb33 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:37.210433 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-dd13eb4a-28e7-45c9-ba10-31cf0dadbb33 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:37.218147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dd13eb4a-28e7-45c9-ba10-31cf0dadbb33 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:37.218642 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dd13eb4a-28e7-45c9-ba10-31cf0dadbb33 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:37.219413 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dd13eb4a-28e7-45c9-ba10-31cf0dadbb33 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:37.219849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dd13eb4a-28e7-45c9-ba10-31cf0dadbb33 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:37.248596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-dd13eb4a-28e7-45c9-ba10-31cf0dadbb33 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043630 May 10 15:07:37.249156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 307/592] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:07:37 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:07:37.303989 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:37.304482 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:37.310679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:37.311124 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:37.311914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:37.312352 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:37.336566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:07:37.407711 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1ac0b270-051a-4054-b88c-8cb0d21350db tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 204 len: 0 microversion: 2.1 time: 0.107255 May 10 15:07:37.408285 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 286/593] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:07:37 2022] DELETE /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:07:37.417670 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:37.418377 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:37.424960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:37.425415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:37.426191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:37.426754 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:37.553769 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:37.561596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c19aa152-e449-4a36-b809-ea1b4a8e2a54 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1677 microversion: 2.1 time: 0.148992 May 10 15:07:37.562169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 308/594] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:37 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:38.580273 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:38.580898 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:38.587133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:38.587576 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:38.588344 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:38.588776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:38.715980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:38.723284 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-02851dc2-17ef-4706-ab3d-6554c5d7d6f0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1677 microversion: 2.1 time: 0.147341 May 10 15:07:38.723851 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 287/595] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:38 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:39.740661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:39.741267 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:39.747940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:39.748390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:39.749149 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:39.749585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:39.879544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:39.886830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e81e0624-4b10-424d-b3fa-404bf844b3aa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1677 microversion: 2.1 time: 0.150007 May 10 15:07:39.887405 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 309/596] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:39 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:40.904361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:40.904980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:40.911717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:40.912398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:40.913360 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:40.914300 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:40.931487 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-29e0804e-07bb-4a2f-b95f-55f219cb2e1f req-5005b55f-ef38-45fd-9ba5-79a9e493efcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11828dfd-b035-4c1b-a5b7-61553717870c", "name": "network-vif-deleted", "tag": "b3c1f55a-48b1-4225-af81-18e16729d371"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:40.939995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-29e0804e-07bb-4a2f-b95f-55f219cb2e1f req-5005b55f-ef38-45fd-9ba5-79a9e493efcc service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:40.940431 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-29e0804e-07bb-4a2f-b95f-55f219cb2e1f req-5005b55f-ef38-45fd-9ba5-79a9e493efcc service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:40.953291 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-29e0804e-07bb-4a2f-b95f-55f219cb2e1f req-5005b55f-ef38-45fd-9ba5-79a9e493efcc service nova] Creating event network-vif-deleted:b3c1f55a-48b1-4225-af81-18e16729d371 for instance 11828dfd-b035-4c1b-a5b7-61553717870c on hv-cinder-83962 May 10 15:07:40.958669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-29e0804e-07bb-4a2f-b95f-55f219cb2e1f req-5005b55f-ef38-45fd-9ba5-79a9e493efcc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031118 May 10 15:07:40.963202 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 310/597] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:07:40.996306 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:41.005329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ffd2088d-6394-45f6-8aea-f96fcdb0fce1 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 200 len: 1610 microversion: 2.1 time: 0.104097 May 10 15:07:41.006021 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 288/598] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:40 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 1610 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:42.023429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:42.024158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:42.030295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:42.030787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:42.031547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:42.032008 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:42.044935 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c HTTP/1.1 May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:07:42.046561 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:07:42.048196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '11828dfd-b035-4c1b-a5b7-61553717870c'} May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:07:42.049102 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:07:42.050677 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:07:42.051903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:07:42.051903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d8209aa5-759c-41ac-828d-13338566b7ba tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 404 len: 111 microversion: 2.1 time: 0.028717 May 10 15:07:42.051903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 311/599] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:42 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:07:42.057369 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2c739f51-b22c-476f-a9aa-74bd925477f8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '.version_select at 0x7f7de0c2e9d0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:42.074909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2c739f51-b22c-476f-a9aa-74bd925477f8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498207178" status: 202 len: 0 microversion: 2.1 time: 0.022064 May 10 15:07:42.075463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 289/600] 10.222.0.83 () {58 vars in 1217 bytes} [Tue May 10 15:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498207178 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:07:42.690600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4276ce2d-9a6d-4a22-aaba-156d38ac9506 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: .version_select at 0x7f7de0cb8c10>, body: {"keypair": {"name": "tempest-keypair-412918471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGySt8dQgZNGh7yAFwsa+vLOp6UanNeYsf+1g/usFQQInklnEQTypGIUt8f8KANu65PCmu/ehl3Uu+hwMWFNMOnzpm363FX/efWO9XLpTXB8VmZ8roX7cZuYrBUaYB1g=="}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:42.704098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-4276ce2d-9a6d-4a22-aaba-156d38ac9506 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:07:42.707843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-4276ce2d-9a6d-4a22-aaba-156d38ac9506 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:07:42.730478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4276ce2d-9a6d-4a22-aaba-156d38ac9506 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043748 May 10 15:07:42.731097 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 312/601] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:07:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:43.938228 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1784821530", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56419087-50d9-434c-b827-6ceec51e5c27"}], "security_groups": [{"name": "tempest-securitygroup--404472184"}], "key_name": "tempest-keypair-412918471", "user_data": "}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:44.038229 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] validate_networks() for [('56419087-50d9-434c-b827-6ceec51e5c27', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:07:44.395079 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:07:44.395504 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:07:44.395981 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:07:44.396390 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:07:44.396805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:07:44.405817 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:44.406267 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:44.407099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:44.407538 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:44.423365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:07:44.427238 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:07:44.437964 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:07:44.440209 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:07:44.487167 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1ca6f703-5ad4-4d42-b7b1-f55dc5e7eab4 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.553654 May 10 15:07:44.487771 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 290/602] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:07:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:07:44.498033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-effa371e-277b-49f8-9170-7450ba9ef960 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:44.498774 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-effa371e-277b-49f8-9170-7450ba9ef960 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:44.553661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-effa371e-277b-49f8-9170-7450ba9ef960 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:44.560796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-effa371e-277b-49f8-9170-7450ba9ef960 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1241 microversion: 2.1 time: 0.066947 May 10 15:07:44.561360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 313/603] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:44 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:45.579560 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:45.580409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:45.587676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:45.588121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:45.588893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:45.589527 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:45.652147 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:45.659623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-92acb7f4-eade-4312-a8dc-1c066d37f6c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1301 microversion: 2.1 time: 0.085345 May 10 15:07:45.660385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 291/604] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:45 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:46.676546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:46.677167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:46.683377 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:46.683829 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:46.684631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:46.685066 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:46.876795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:46.885123 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-cbc22af2-01f2-4b95-a532-f54333c3bdd7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1366 microversion: 2.1 time: 0.212323 May 10 15:07:46.885738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 314/605] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:46 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:47.159964 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-6ee7567d-df45-4996-a14d-14fc7d384546 req-6b416d66-e4e1-4d2c-a331-f4a5addaeaba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423901c-6ff6-4d8e-88fd-fc1fd3f4309b", "tag": "ff51cc44-1439-4f2f-9f84-c17754faedc2"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:47.171060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-6ee7567d-df45-4996-a14d-14fc7d384546 req-6b416d66-e4e1-4d2c-a331-f4a5addaeaba service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:47.171507 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-6ee7567d-df45-4996-a14d-14fc7d384546 req-6b416d66-e4e1-4d2c-a331-f4a5addaeaba service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:47.183618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-6ee7567d-df45-4996-a14d-14fc7d384546 req-6b416d66-e4e1-4d2c-a331-f4a5addaeaba service nova] Creating event network-changed:ff51cc44-1439-4f2f-9f84-c17754faedc2 for instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b on hv-cinder-83962 May 10 15:07:47.188520 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-6ee7567d-df45-4996-a14d-14fc7d384546 req-6b416d66-e4e1-4d2c-a331-f4a5addaeaba service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033723 May 10 15:07:47.189094 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 292/606] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:47.354867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2bb46a6c-51f5-4779-b294-6643511157f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77267a0c-57bd-40c9-adfa-81252eafe318"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:47.356006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2bb46a6c-51f5-4779-b294-6643511157f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:47.361805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2bb46a6c-51f5-4779-b294-6643511157f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:47.362259 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2bb46a6c-51f5-4779-b294-6643511157f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:47.363071 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2bb46a6c-51f5-4779-b294-6643511157f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:47.363508 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2bb46a6c-51f5-4779-b294-6643511157f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:47.620626 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2bb46a6c-51f5-4779-b294-6643511157f6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269787 May 10 15:07:47.621268 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 315/607] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:07:47 2022] POST /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:47.903101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:47.903847 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:47.910287 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:47.910883 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:47.911649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:47.912082 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:48.042090 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:48.049474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9ea580da-5a30-496f-bba1-54229fb77a88 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1366 microversion: 2.1 time: 0.150722 May 10 15:07:48.050043 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 293/608] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:47 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:49.067616 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:49.068331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:49.075023 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:49.075486 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:49.076259 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:49.076702 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:49.306378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:49.313794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8b98ce0d-68d1-47dd-b48c-e63d81a0004d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1366 microversion: 2.1 time: 0.250855 May 10 15:07:49.314361 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 316/609] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:49 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:50.329435 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:50.330057 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:50.336992 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:50.337450 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:50.338224 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:50.338691 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:50.463712 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:50.470896 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0dd52b7c-113f-40b5-b3ad-9083efecb0f7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1366 microversion: 2.1 time: 0.145390 May 10 15:07:50.471467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 294/610] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:50 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:51.487528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:51.488141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:51.494917 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:51.495370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:51.496129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:51.496565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:51.627419 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:51.635159 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5e08e78d-183f-4f85-9dbc-f33f923a6ff9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1366 microversion: 2.1 time: 0.151536 May 10 15:07:51.635727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 317/611] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:51 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:52.089295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-cf572638-e5b4-4314-ad8d-c5faa14d579d req-e1464fb9-cf2a-4f8c-9736-7790e1be93a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b423901c-6ff6-4d8e-88fd-fc1fd3f4309b", "name": "network-vif-plugged", "status": "completed", "tag": "ff51cc44-1439-4f2f-9f84-c17754faedc2"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:52.097543 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-cf572638-e5b4-4314-ad8d-c5faa14d579d req-e1464fb9-cf2a-4f8c-9736-7790e1be93a1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:52.097984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-cf572638-e5b4-4314-ad8d-c5faa14d579d req-e1464fb9-cf2a-4f8c-9736-7790e1be93a1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:52.111827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-cf572638-e5b4-4314-ad8d-c5faa14d579d req-e1464fb9-cf2a-4f8c-9736-7790e1be93a1 service nova] Creating event network-vif-plugged:ff51cc44-1439-4f2f-9f84-c17754faedc2 for instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b on hv-cinder-83962 May 10 15:07:52.116761 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-cf572638-e5b4-4314-ad8d-c5faa14d579d req-e1464fb9-cf2a-4f8c-9736-7790e1be93a1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 May 10 15:07:52.117422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 295/612] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:52.651571 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:52.652184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:52.658667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:52.659151 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:52.659918 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:52.660355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:52.786027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:52.793267 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bfc79246-9f4b-4220-bd9b-cd0371fab07a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1366 microversion: 2.1 time: 0.146181 May 10 15:07:52.793837 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 318/613] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:52 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:53.810690 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:53.811528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:53.817575 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:53.818093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:53.818970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:53.819409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:54.102677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:54.109914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e700b944-3282-4078-aa9f-b47b6f12df4a tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1366 microversion: 2.1 time: 0.303917 May 10 15:07:54.110509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 296/614] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:53 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:55.126714 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:55.127329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:55.133594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:55.134045 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:55.134879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:55.135321 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:55.262103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:55.269286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7af40feb-6e71-45b1-9864-2e2c34aa2714 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1554 microversion: 2.1 time: 0.146538 May 10 15:07:55.269855 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 319/615] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:55 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:55.285479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-72d870b2-4a55-4afb-8786-d085f6225e79 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:55.285975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-72d870b2-4a55-4afb-8786-d085f6225e79 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:55.292799 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-72d870b2-4a55-4afb-8786-d085f6225e79 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:55.293244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-72d870b2-4a55-4afb-8786-d085f6225e79 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:55.294035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-72d870b2-4a55-4afb-8786-d085f6225e79 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:55.294496 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-72d870b2-4a55-4afb-8786-d085f6225e79 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:55.368108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-72d870b2-4a55-4afb-8786-d085f6225e79 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086338 May 10 15:07:55.368704 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 297/616] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:07:55 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:07:56.148063 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:56.149715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:56.156904 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:56.157392 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:56.158194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:56.158661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:56.181797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lazy-loading 'flavor' on Instance uuid b05c7bca-c0fc-42f3-8561-19dd08b84581 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:07:56.318732 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-25b4a347-a9c3-4318-91aa-c6832b6ddcb6 req-6e1896fe-96ef-464d-aed0-11ace48c63d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423901c-6ff6-4d8e-88fd-fc1fd3f4309b", "tag": "ff51cc44-1439-4f2f-9f84-c17754faedc2"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:07:56.328676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-25b4a347-a9c3-4318-91aa-c6832b6ddcb6 req-6e1896fe-96ef-464d-aed0-11ace48c63d0 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:56.329192 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-25b4a347-a9c3-4318-91aa-c6832b6ddcb6 req-6e1896fe-96ef-464d-aed0-11ace48c63d0 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:56.341550 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-25b4a347-a9c3-4318-91aa-c6832b6ddcb6 req-6e1896fe-96ef-464d-aed0-11ace48c63d0 service nova] Creating event network-changed:ff51cc44-1439-4f2f-9f84-c17754faedc2 for instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b on hv-cinder-83962 May 10 15:07:56.346694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-25b4a347-a9c3-4318-91aa-c6832b6ddcb6 req-6e1896fe-96ef-464d-aed0-11ace48c63d0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031537 May 10 15:07:56.347429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 298/617] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:07:56.407249 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bc2cff3d-3635-48f6-be62-3751bb7c3ace tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/action" status: 200 len: 32 microversion: 2.1 time: 0.262710 May 10 15:07:56.411752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 320/618] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:07:56 2022] POST /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:07:56.420281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:56.421152 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:56.430036 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:56.430519 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:56.431382 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:56.431817 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:56.564851 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:56.574116 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f75cfdb7-8c29-4d0c-adc8-ce38d099c010 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.160639 May 10 15:07:56.575287 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 299/619] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:56 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:57.593948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:57.594686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:57.600715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:57.601173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:57.602609 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:57.603053 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:57.729057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:57.737029 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-47aaa5f7-834b-4337-9211-c1d4c5313765 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.147753 May 10 15:07:57.737638 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 321/620] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:57 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:58.754300 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:58.754955 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:58.761341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:58.761796 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:58.762595 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:58.763034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:58.889451 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:07:58.897177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9d4f98ca-a7e1-446a-aa28-84e5ef932eee tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.146750 May 10 15:07:58.897754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 300/621] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:58 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:07:59.572394 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-963ec5b1-f1ba-4fde-acb4-dcf050521005 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:59.573074 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-963ec5b1-f1ba-4fde-acb4-dcf050521005 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:59.579179 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963ec5b1-f1ba-4fde-acb4-dcf050521005 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.579626 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963ec5b1-f1ba-4fde-acb4-dcf050521005 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.580378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963ec5b1-f1ba-4fde-acb4-dcf050521005 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.580808 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963ec5b1-f1ba-4fde-acb4-dcf050521005 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.608430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-963ec5b1-f1ba-4fde-acb4-dcf050521005 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments/f2e4abd4-9651-4b9c-8b7d-0297ffbe004b" status: 200 len: 194 microversion: 2.20 time: 0.040604 May 10 15:07:59.609005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 322/622] 10.222.0.83 () {60 vars in 1453 bytes} [Tue May 10 15:07:59 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments/f2e4abd4-9651-4b9c-8b7d-0297ffbe004b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:07:59.669763 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:59.670263 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:59.676117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.676566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.677330 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.677768 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.800121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lazy-loading 'services' on Instance uuid a4aac7eb-fbec-4d86-82c9-1237542ad61a {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:07:59.908378 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c12efc91-a514-4d16-9b6f-483785d69bf8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments/f2e4abd4-9651-4b9c-8b7d-0297ffbe004b" status: 202 len: 0 microversion: 2.20 time: 0.242358 May 10 15:07:59.909411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 301/623] 10.222.0.83 () {60 vars in 1456 bytes} [Tue May 10 15:07:59 2022] DELETE /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments/f2e4abd4-9651-4b9c-8b7d-0297ffbe004b => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 15:07:59.915446 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:59.916372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:59.918210 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e109ae9a-280d-4317-b33e-c9221cbd9285 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:07:59.919420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e109ae9a-280d-4317-b33e-c9221cbd9285 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:07:59.922568 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.923021 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.923793 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.924219 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.925727 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e109ae9a-280d-4317-b33e-c9221cbd9285 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.926176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e109ae9a-280d-4317-b33e-c9221cbd9285 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.927355 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e109ae9a-280d-4317-b33e-c9221cbd9285 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:07:59.927797 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e109ae9a-280d-4317-b33e-c9221cbd9285 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:07:59.958808 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e109ae9a-280d-4317-b33e-c9221cbd9285 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045005 May 10 15:07:59.959389 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 302/624] 10.222.0.83 () {60 vars in 1342 bytes} [Tue May 10 15:07:59 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:08:00.063966 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:00.072286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-60460067-9a75-484d-904a-c4430b6280b3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.160762 May 10 15:08:00.072852 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 323/625] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:07:59 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:00.970415 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bf9e21a9-9724-4f5b-801b-fdd52579b550 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:00.971379 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bf9e21a9-9724-4f5b-801b-fdd52579b550 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:00.977319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf9e21a9-9724-4f5b-801b-fdd52579b550 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:00.977772 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf9e21a9-9724-4f5b-801b-fdd52579b550 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:00.978560 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf9e21a9-9724-4f5b-801b-fdd52579b550 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:00.978995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf9e21a9-9724-4f5b-801b-fdd52579b550 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:01.008387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bf9e21a9-9724-4f5b-801b-fdd52579b550 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041353 May 10 15:08:01.008952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 303/626] 10.222.0.83 () {60 vars in 1342 bytes} [Tue May 10 15:08:00 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:01.073333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:01.073850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:01.080195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:01.080647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:01.081406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:01.081842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:01.088826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:01.089468 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:01.095372 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:01.095822 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:01.096586 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:01.097020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:01.107578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:08:01.194618 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f125ab21-0e6e-4998-9e01-68095e3351b0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 204 len: 0 microversion: 2.20 time: 0.124578 May 10 15:08:01.195406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 324/627] 10.222.0.83 () {60 vars in 1279 bytes} [Tue May 10 15:08:01 2022] DELETE /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 15:08:01.203952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:01.204770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:01.212193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:01.212645 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:01.213430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:01.213870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:01.275886 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:01.284140 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2fd2d1f7-2a9a-4cee-b816-bf0c06f21fe4 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.199132 May 10 15:08:01.284709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 304/628] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:01 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:08:01.343167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:01.350946 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:01.353031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:01.354185 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a3a7a5d5-748d-4528-8f19-eb46fe158c04 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.154484 May 10 15:08:01.354786 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 325/629] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:01 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:08:02.373103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:02.373734 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:02.379956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:02.380404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:02.381160 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:02.381589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:02.402527 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:02.403144 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:02.409025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:02.409471 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:02.410242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:02.410708 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:02.509082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:02.517161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:02.518846 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:02.520103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-74fd8b5d-679e-483c-9248-756e78172f06 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.151072 May 10 15:08:02.520667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 326/630] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:02 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:08:02.546566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:02.554532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-22f5841a-4f93-4a76-a952-b41ba53e921d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.256543 May 10 15:08:02.555589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 305/631] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:02 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:03.538262 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:03.538931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:03.545746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:03.546205 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:03.547000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:03.547488 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:03.572819 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:03.573517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:03.580807 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:03.581261 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:03.582037 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:03.582500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:03.712427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:03.720514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a99e0e2a-f3eb-4d94-802d-c72b8e80d781 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.152138 May 10 15:08:03.721239 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 306/632] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:03 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:08:04.080273 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:04.089059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:04.090690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:04.091837 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-453740e2-66a1-46b7-a8aa-fe38305816dd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1724 microversion: 2.20 time: 0.557489 May 10 15:08:04.092396 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 327/633] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:03 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1724 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:04.680932 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-81a4a2ec-7009-4d89-bfe9-f729bd4a7530 req-9b5990de-8722-4824-abd2-98994f52bda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aac7eb-fbec-4d86-82c9-1237542ad61a", "name": "network-vif-deleted", "tag": "c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:04.689008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-81a4a2ec-7009-4d89-bfe9-f729bd4a7530 req-9b5990de-8722-4824-abd2-98994f52bda7 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:04.689534 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-81a4a2ec-7009-4d89-bfe9-f729bd4a7530 req-9b5990de-8722-4824-abd2-98994f52bda7 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:04.703814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-81a4a2ec-7009-4d89-bfe9-f729bd4a7530 req-9b5990de-8722-4824-abd2-98994f52bda7 service nova] Creating event network-vif-deleted:c2c21f6f-dc6e-4e3e-8c29-968e9f87f9b7 for instance a4aac7eb-fbec-4d86-82c9-1237542ad61a on hv-cinder-83962 May 10 15:08:04.708849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-81a4a2ec-7009-4d89-bfe9-f729bd4a7530 req-9b5990de-8722-4824-abd2-98994f52bda7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 May 10 15:08:04.709482 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 307/634] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:04.739462 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:04.741181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:04.749224 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:04.749878 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:04.751010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:04.751704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:04.904519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:04.917903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-95206036-be79-44f8-8d22-77b437c435a6 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.179437 May 10 15:08:04.917903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 328/635] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:04 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:05.111263 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:05.111965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:05.119045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:05.119501 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:05.120283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:05.120717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:05.158421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:05.159143 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:05.159671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lazy-loading 'fault' on Instance uuid a4aac7eb-fbec-4d86-82c9-1237542ad61a {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:08:05.206351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:05.215361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:05.217199 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:05.218526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1c713da2-b309-435f-a9cc-61a2a808710c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 200 len: 1372 microversion: 2.20 time: 0.111579 May 10 15:08:05.219167 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 308/636] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:05 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:05.932757 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:05.933368 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:05.939673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:05.940132 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:05.940980 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:05.941534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:06.068730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:06.077116 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-78c9e629-baac-4ba5-bb82-9db6e15d7997 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.148940 May 10 15:08:06.077683 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 329/637] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:05 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:06.236955 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:06.237561 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:06.244764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:06.245205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:06.246101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:06.246572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:06.259545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] HTTP exception thrown: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Request method failure captured: May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a HTTP/1.1 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien630sv3SSiXrtu4TTF5j_1LoQ6EyyFcDcAyD9ZAf15JsCiQDGnX8OafZXs1bNcXMe9Ze5ezrn8esDnXBhCL46hhlTXYbxVllVRUwiXNmsBW80CA7FijC-LlzVYmrFaxI213asZW7Lll8d_hKDJsxrVe01csrkx7wIrpfaDASSHtVj8 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Openstack-Nova-Api-Version: 2.20 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:08:06.261154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: aa56c83ab8494901b85d00d4f592e5ce May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:08:06.262747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'a4aac7eb-fbec-4d86-82c9-1237542ad61a'} May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:08:06.263638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:08:06.265123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:06.266376 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Returning 404 to user: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:08:06.266376 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5cb5cf74-7b95-4dc1-87e1-36a8decb036d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 404 len: 111 microversion: 2.20 time: 0.029465 May 10 15:08:06.266376 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 309/638] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:06 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 15:08:06.271931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0f4e4de3-2043-467e-ba89-e84426c9c32a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '.version_select at 0x7f7de5d334c0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:06.289979 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0f4e4de3-2043-467e-ba89-e84426c9c32a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670522026" status: 204 len: 0 microversion: 2.20 time: 0.021920 May 10 15:08:06.290664 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 330/639] 10.222.0.83 () {60 vars in 1261 bytes} [Tue May 10 15:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670522026 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 15:08:06.911446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-459659bd-1edb-44f8-a4d9-81f82825046f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'create', calling method: .version_select at 0x7f7de5d628b0>, body: {"keypair": {"name": "tempest-keypair-2005969375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsPo+Tih2mZA0cxKZ/h1g5Y8N+4fVvwq5k8qExHFsVCWf22cFpUTGcZnu3YswZtWxf///flwHx7y++nqsqijFWVltQ+YtMvtYgdWfhm/nobjJD1bWXpiJpVd2BdnmM09g=="}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:06.925136 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-459659bd-1edb-44f8-a4d9-81f82825046f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for project 09c6a716650343c18e62bbe7235e48c8. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:08:06.928891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-459659bd-1edb-44f8-a4d9-81f82825046f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for user aa56c83ab8494901b85d00d4f592e5ce and project 09c6a716650343c18e62bbe7235e48c8. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:08:06.949999 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-459659bd-1edb-44f8-a4d9-81f82825046f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.042506 May 10 15:08:06.950617 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 310/640] 10.222.0.83 () {62 vars in 1199 bytes} [Tue May 10 15:08:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 44 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 15:08:07.094466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:07.095237 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:07.101839 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:07.102297 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:07.103114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:07.103558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:07.248492 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:07.256845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-585b1a62-213d-49ae-b9e1-8146aabf92c0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.166609 May 10 15:08:07.257440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 331/641] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:07 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:08.276160 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:08.277227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:08.284074 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:08.284744 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:08.285511 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:08.285945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:08.402650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1414582313", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98f2117d-e406-4c1d-b8a0-22d70ac12c81"}], "security_groups": [{"name": "tempest-securitygroup--903812082"}], "key_name": "tempest-keypair-2005969375", "user_data": "}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:08.418804 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:08.427561 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-32583f52-3282-4dde-aa26-06be610c1c92 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.157224 May 10 15:08:08.428198 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 311/642] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:08 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:08.499297 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] validate_networks() for [('98f2117d-e406-4c1d-b8a0-22d70ac12c81', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:08:08.894924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:08:08.895346 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:08:08.895818 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:08:08.896223 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:08:08.896659 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:08:08.905181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:08.905624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:08.906450 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:08.906890 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:08.922905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for project 09c6a716650343c18e62bbe7235e48c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:08:08.926760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Getting quotas for user aa56c83ab8494901b85d00d4f592e5ce and project 09c6a716650343c18e62bbe7235e48c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:08:08.937891 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:08:08.940158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:08:08.984710 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d362c90a-b8ed-4c43-b7b2-61286a6fbf0a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.586997 May 10 15:08:08.985367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 332/643] 10.222.0.83 () {62 vars in 1187 bytes} [Tue May 10 15:08:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 15:08:08.995820 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a68e37ac-bc3e-4c42-a3b1-0fd29a40c1a2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:08.996517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a68e37ac-bc3e-4c42-a3b1-0fd29a40c1a2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:09.051708 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a68e37ac-bc3e-4c42-a3b1-0fd29a40c1a2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:09.059434 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a68e37ac-bc3e-4c42-a3b1-0fd29a40c1a2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:09.060957 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a68e37ac-bc3e-4c42-a3b1-0fd29a40c1a2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:09.062052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a68e37ac-bc3e-4c42-a3b1-0fd29a40c1a2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1282 microversion: 2.20 time: 0.070635 May 10 15:08:09.062683 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 312/644] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:08 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:09.446034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:09.446715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:09.453717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:09.454180 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:09.454987 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:09.455426 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:09.584282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:09.593391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-08517641-b413-45bc-b282-0fd3cd53afd3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.152388 May 10 15:08:09.594011 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 333/645] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:09 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:10.080381 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:10.081024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:10.088677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:10.089125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:10.089894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:10.090327 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:10.152563 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:10.162003 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:10.164034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:10.165149 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7d0d9cf8-2c75-4f5f-b9db-2faf34d52d79 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1342 microversion: 2.20 time: 0.088706 May 10 15:08:10.165709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 313/646] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:10 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:10.611210 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:10.611820 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:10.619012 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:10.619467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:10.620246 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:10.620686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:10.863914 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:10.872988 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-36ef2e5c-de2f-4335-8cc0-0300fca5288f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.265648 May 10 15:08:10.873818 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 334/647] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:10 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:11.182153 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:11.183008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:11.189251 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:11.189694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:11.190484 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:11.190921 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:11.327024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:11.335768 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:11.338100 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:11.339239 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6b889d33-d47b-481f-9e9c-401d8203babd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1407 microversion: 2.20 time: 0.160981 May 10 15:08:11.339798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 314/648] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:11 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:11.546342 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-aef6ea72-143d-4cec-a901-8a02e66cf1d5 req-15504b07-8388-4c13-b3bb-e818e79fb458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b73b3a-5044-4050-9df7-63449017d71b", "tag": "894eaf97-5fb6-48fd-9978-9efc8dd336f9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:11.555180 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-aef6ea72-143d-4cec-a901-8a02e66cf1d5 req-15504b07-8388-4c13-b3bb-e818e79fb458 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:11.555901 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-aef6ea72-143d-4cec-a901-8a02e66cf1d5 req-15504b07-8388-4c13-b3bb-e818e79fb458 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:11.567354 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-aef6ea72-143d-4cec-a901-8a02e66cf1d5 req-15504b07-8388-4c13-b3bb-e818e79fb458 service nova] Creating event network-changed:894eaf97-5fb6-48fd-9978-9efc8dd336f9 for instance b4b73b3a-5044-4050-9df7-63449017d71b on hv-cinder-83962 May 10 15:08:11.575441 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-aef6ea72-143d-4cec-a901-8a02e66cf1d5 req-15504b07-8388-4c13-b3bb-e818e79fb458 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 May 10 15:08:11.576070 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 335/649] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:11.889926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:11.890599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:11.896377 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:11.896827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:11.897621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:11.898057 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:12.030051 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:12.037789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0d63c8fd-c80c-4d28-b0e6-6c5bc4a470b8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.151690 May 10 15:08:12.038355 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 315/650] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:11 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:12.357939 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:12.358661 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:12.364761 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:12.365210 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:12.365968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:12.366412 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:12.494968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:12.503208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:12.504687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:12.505764 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8e682a9e-3083-42b0-9282-d1afbc5bd264 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1407 microversion: 2.20 time: 0.152521 May 10 15:08:12.506328 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 336/651] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:12 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:13.055193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:13.055805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:13.062080 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:13.062576 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:13.063339 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:13.063775 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:13.189754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:13.197489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a6c740f8-9915-4d68-9fca-a19b5de9d22c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.146731 May 10 15:08:13.198061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 316/652] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:13 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:13.528086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:13.528922 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:13.535456 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:13.535904 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:13.536765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:13.537098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:13.670278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:13.677940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:13.679481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:13.680611 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-83d009e1-1622-42eb-8617-c82aeab55206 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1407 microversion: 2.20 time: 0.159846 May 10 15:08:13.681169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 337/653] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:13 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:14.214982 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:14.215593 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:14.221683 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:14.222133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:14.222930 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:14.223364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:14.351576 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:14.359395 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fb80cc88-7b68-4afd-a806-73dfb1d7dac2 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.148876 May 10 15:08:14.359967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 317/654] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:14 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:14.698976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:14.699744 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:14.706013 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:14.706649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:14.707414 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:14.707853 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:14.832948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:14.840707 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:14.842201 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:14.843325 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d6f761c3-a6f4-4ad2-9107-3861dcb9a14f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1407 microversion: 2.20 time: 0.148862 May 10 15:08:14.843890 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 338/655] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:14 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:15.376612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:15.377222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:15.384290 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:15.384764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:15.385536 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:15.385976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:15.515582 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:15.523315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-62c54fd4-5f9a-48c0-8697-875fd7ba9fec tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.150534 May 10 15:08:15.523888 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 318/656] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:15 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:15.860959 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:15.861577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:15.868429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:15.868882 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:15.869648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:15.870088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:16.213370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:16.221211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:16.222733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:16.223849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3a11a06e-972e-49ac-b713-0d94d33e1a53 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1407 microversion: 2.20 time: 0.366736 May 10 15:08:16.224800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 339/657] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:15 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:16.274577 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-139816d6-70ae-4015-8414-f815a8971feb req-d683a6dd-9491-42f8-8340-91b369ecb4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b73b3a-5044-4050-9df7-63449017d71b", "name": "network-vif-plugged", "status": "completed", "tag": "894eaf97-5fb6-48fd-9978-9efc8dd336f9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:16.283339 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-139816d6-70ae-4015-8414-f815a8971feb req-d683a6dd-9491-42f8-8340-91b369ecb4e6 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:16.283864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-139816d6-70ae-4015-8414-f815a8971feb req-d683a6dd-9491-42f8-8340-91b369ecb4e6 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:16.296759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-139816d6-70ae-4015-8414-f815a8971feb req-d683a6dd-9491-42f8-8340-91b369ecb4e6 service nova] Creating event network-vif-plugged:894eaf97-5fb6-48fd-9978-9efc8dd336f9 for instance b4b73b3a-5044-4050-9df7-63449017d71b on hv-cinder-83962 May 10 15:08:16.301578 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-139816d6-70ae-4015-8414-f815a8971feb req-d683a6dd-9491-42f8-8340-91b369ecb4e6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 May 10 15:08:16.302173 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 319/658] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:16.540958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:16.541573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:16.547450 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:16.547922 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:16.548686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:16.549125 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:16.674692 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:16.682771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d599ee7f-35f0-45c0-a93b-3b5c07ded080 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.146224 May 10 15:08:16.683346 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 340/659] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:16 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:17.243929 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:17.244563 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:17.251023 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:17.251481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:17.252267 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:17.252717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:17.378872 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:17.386564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:17.388057 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:17.389160 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-552da43b-115d-49b8-9dba-68c7c8afec2c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1407 microversion: 2.20 time: 0.150576 May 10 15:08:17.389728 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 320/660] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:17 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:17.705307 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:17.705908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:17.713979 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:17.714463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:17.715598 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:17.715807 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:17.838796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:17.846576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2595fd6a-79c8-41c7-88a1-abb9649b85d1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.145248 May 10 15:08:17.847150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 341/661] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:17 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:18.407120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:18.407734 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:18.414056 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:18.414541 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:18.415313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:18.415752 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:18.541725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:18.549512 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:18.551055 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:18.552206 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-61c62423-9d6f-4a53-a6d1-19b7fd929e44 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1600 microversion: 2.20 time: 0.149046 May 10 15:08:18.552767 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 321/662] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:08:18 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:08:18.569786 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bff1b52d-6596-4765-8560-b2c92c17e9ee tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:18.570901 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bff1b52d-6596-4765-8560-b2c92c17e9ee tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:18.576794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bff1b52d-6596-4765-8560-b2c92c17e9ee tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:18.577299 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bff1b52d-6596-4765-8560-b2c92c17e9ee tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:18.578065 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bff1b52d-6596-4765-8560-b2c92c17e9ee tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:18.578536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bff1b52d-6596-4765-8560-b2c92c17e9ee tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:18.653327 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bff1b52d-6596-4765-8560-b2c92c17e9ee tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087323 May 10 15:08:18.653924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 342/663] 10.222.0.83 () {60 vars in 1315 bytes} [Tue May 10 15:08:18 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:08:18.864309 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:18.864984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:18.871400 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:18.872117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:18.872897 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:18.873332 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:18.999025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:19.006862 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-575ed8a0-97e9-438d-af21-de7b276be70b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.146419 May 10 15:08:19.007443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 322/664] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:18 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:19.860864 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-5cb31b64-da0d-430f-91cf-0d835824956d req-c550271a-c796-4782-b5cb-302c62a23f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b73b3a-5044-4050-9df7-63449017d71b", "tag": "894eaf97-5fb6-48fd-9978-9efc8dd336f9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:19.868956 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-5cb31b64-da0d-430f-91cf-0d835824956d req-c550271a-c796-4782-b5cb-302c62a23f39 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:19.869400 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-5cb31b64-da0d-430f-91cf-0d835824956d req-c550271a-c796-4782-b5cb-302c62a23f39 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:19.880386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-5cb31b64-da0d-430f-91cf-0d835824956d req-c550271a-c796-4782-b5cb-302c62a23f39 service nova] Creating event network-changed:894eaf97-5fb6-48fd-9978-9efc8dd336f9 for instance b4b73b3a-5044-4050-9df7-63449017d71b on hv-cinder-83962 May 10 15:08:19.885791 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-5cb31b64-da0d-430f-91cf-0d835824956d req-c550271a-c796-4782-b5cb-302c62a23f39 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086369 May 10 15:08:19.886480 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 343/665] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:20.024245 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:20.025142 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:20.031613 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:20.032063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:20.032842 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:20.033277 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:20.164308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:20.172507 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5ff54627-f8fc-4cec-ad9c-88f24841f10f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.152184 May 10 15:08:20.173185 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 323/666] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:20 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:21.191032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:21.191739 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:21.198296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:21.198777 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:21.199546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:21.199986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:21.325921 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:21.334030 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-97994a2d-9077-4278-8fd0-7fb39a8a3c78 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1737 microversion: 2.1 time: 0.147527 May 10 15:08:21.334556 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 344/667] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:21 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:22.352173 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:22.352822 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:22.359299 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.359757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:22.360641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.361092 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:22.488079 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:22.495946 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-35c67777-9775-49a3-af11-08691333448b tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1717 microversion: 2.1 time: 0.148219 May 10 15:08:22.496523 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 324/668] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:22 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1717 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:22.549992 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:22.550626 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:22.556891 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.557345 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:22.558113 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.558590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:22.636820 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] HTTP exception thrown: Cannot 'detach_volume' instance b05c7bca-c0fc-42f3-8561-19dd08b84581 while it is in vm_state rescued May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Request method failure captured: May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: DELETE /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments/77267a0c-57bd-40c9-adfa-81252eafe318 HTTP/1.1 May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6lGI9oNd8c6_-54gyQ9qygpcyZVzBMrZGY5krraBhjSheFh_7mV52JYu0SKpGeICkITYh6gJdMWTAKknV_0ZJKuf7n29qMlO0glIoiz8wNfWZfusvZgEb5DfBbKDG_Kv4wARTGsyY81ZxDRPnvm-MT6v8Phg8x5BC5x59at72EcIM May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:08:22.638440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: e690e810cdb54431af33651d13272239 May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:08:22.640033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Cannot 'detach_volume' instance b05c7bca-c0fc-42f3-8561-19dd08b84581 while it is in vm_state rescued May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'server_id': 'b05c7bca-c0fc-42f3-8561-19dd08b84581', 'id': '77267a0c-57bd-40c9-adfa-81252eafe318'} May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b05c7bca-c0fc-42f3-8561-19dd08b84581 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:08:22.640854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b05c7bca-c0fc-42f3-8561-19dd08b84581 while it is in vm_state rescued May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b05c7bca-c0fc-42f3-8561-19dd08b84581 while it is in vm_state rescued May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:08:22.642600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Returning 409 to user: Cannot 'detach_volume' instance b05c7bca-c0fc-42f3-8561-19dd08b84581 while it is in vm_state rescued {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:08:22.643897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7e762b1a-f5e3-49aa-8141-0830f4fdae8f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments/77267a0c-57bd-40c9-adfa-81252eafe318" status: 409 len: 152 microversion: 2.1 time: 0.093797 May 10 15:08:22.643897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 345/669] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:08:22 2022] DELETE /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments/77267a0c-57bd-40c9-adfa-81252eafe318 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 15:08:22.649399 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b554c0c6-d84e-4fd2-89e3-8e4562bc1cf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:22.649925 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b554c0c6-d84e-4fd2-89e3-8e4562bc1cf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:22.655754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b554c0c6-d84e-4fd2-89e3-8e4562bc1cf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.656203 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b554c0c6-d84e-4fd2-89e3-8e4562bc1cf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:22.656968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b554c0c6-d84e-4fd2-89e3-8e4562bc1cf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.657403 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b554c0c6-d84e-4fd2-89e3-8e4562bc1cf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:22.723666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b554c0c6-d84e-4fd2-89e3-8e4562bc1cf0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "POST /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/action" status: 202 len: 0 microversion: 2.1 time: 0.078493 May 10 15:08:22.724371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 325/670] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:08:22 2022] POST /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:08:22.733449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:22.734055 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:22.741139 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.741934 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:22.742904 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:22.743509 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:23.162321 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:23.170138 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ae209113-b547-4111-b346-a6eac5ab4dc8 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1725 microversion: 2.1 time: 0.440614 May 10 15:08:23.170951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 346/671] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:22 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1725 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:24.188999 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:24.189634 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:24.196217 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:24.196665 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:24.197423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:24.197857 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:24.323041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:24.330808 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f6c04c76-65a0-4ddf-b718-25eb8baff1c1 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1725 microversion: 2.1 time: 0.146576 May 10 15:08:24.331378 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 326/672] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:24 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:25.348468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:25.349106 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:25.355962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:25.356410 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:25.357172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:25.357599 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:25.486721 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:25.494616 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-73c15c73-517b-4495-980b-f4feab4d82d7 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1725 microversion: 2.1 time: 0.149992 May 10 15:08:25.495186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 347/673] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:25 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:26.511995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:26.512602 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:26.519015 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:26.519466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:26.520226 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:26.520663 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:26.648683 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:26.656398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cb5f61e2-33d2-48b3-95bf-a579da1be2a3 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1731 microversion: 2.1 time: 0.148296 May 10 15:08:26.656984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 327/674] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:26 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:26.673524 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d8b9d491-2b5b-4331-8664-86d653910536 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:26.674011 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d8b9d491-2b5b-4331-8664-86d653910536 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:26.680842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8b9d491-2b5b-4331-8664-86d653910536 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:26.681292 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8b9d491-2b5b-4331-8664-86d653910536 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:26.682054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8b9d491-2b5b-4331-8664-86d653910536 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:26.682513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d8b9d491-2b5b-4331-8664-86d653910536 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:26.756090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d8b9d491-2b5b-4331-8664-86d653910536 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086435 May 10 15:08:26.756689 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 348/675] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:08:26 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:08:27.641782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-417bd60d-d894-4255-a9a0-e88afccd9887 req-9a59e17b-4c09-4916-9729-7c164f7d0c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05c7bca-c0fc-42f3-8561-19dd08b84581", "tag": "ea78e5d2-ebba-4237-9401-0a7bce6e10b9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:27.650503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-417bd60d-d894-4255-a9a0-e88afccd9887 req-9a59e17b-4c09-4916-9729-7c164f7d0c44 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:27.650950 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-417bd60d-d894-4255-a9a0-e88afccd9887 req-9a59e17b-4c09-4916-9729-7c164f7d0c44 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:27.661970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-417bd60d-d894-4255-a9a0-e88afccd9887 req-9a59e17b-4c09-4916-9729-7c164f7d0c44 service nova] Creating event network-changed:ea78e5d2-ebba-4237-9401-0a7bce6e10b9 for instance b05c7bca-c0fc-42f3-8561-19dd08b84581 on hv-cinder-83962 May 10 15:08:27.666917 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-417bd60d-d894-4255-a9a0-e88afccd9887 req-9a59e17b-4c09-4916-9729-7c164f7d0c44 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028724 May 10 15:08:27.667838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 328/676] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:29.683245 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-50b2c2a2-635c-46dd-9a56-2251563b78d0 req-d5e72c35-aa6a-4599-85a0-f800a13bf74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05c7bca-c0fc-42f3-8561-19dd08b84581", "tag": "ea78e5d2-ebba-4237-9401-0a7bce6e10b9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:29.691285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-50b2c2a2-635c-46dd-9a56-2251563b78d0 req-d5e72c35-aa6a-4599-85a0-f800a13bf74c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:29.691730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-50b2c2a2-635c-46dd-9a56-2251563b78d0 req-d5e72c35-aa6a-4599-85a0-f800a13bf74c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:29.702484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-50b2c2a2-635c-46dd-9a56-2251563b78d0 req-d5e72c35-aa6a-4599-85a0-f800a13bf74c service nova] Creating event network-changed:ea78e5d2-ebba-4237-9401-0a7bce6e10b9 for instance b05c7bca-c0fc-42f3-8561-19dd08b84581 on hv-cinder-83962 May 10 15:08:29.707254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-50b2c2a2-635c-46dd-9a56-2251563b78d0 req-d5e72c35-aa6a-4599-85a0-f800a13bf74c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028715 May 10 15:08:29.707828 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 349/677] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:40.042105 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9d6ba374-f8af-4542-acb3-12aa37e868c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:40.042728 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9d6ba374-f8af-4542-acb3-12aa37e868c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:40.048906 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d6ba374-f8af-4542-acb3-12aa37e868c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:40.049349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d6ba374-f8af-4542-acb3-12aa37e868c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:40.050106 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d6ba374-f8af-4542-acb3-12aa37e868c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:40.050571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d6ba374-f8af-4542-acb3-12aa37e868c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:40.073580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9d6ba374-f8af-4542-acb3-12aa37e868c5 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/ips" status: 200 len: 147 microversion: 2.1 time: 0.083780 May 10 15:08:40.074128 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 329/678] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:08:39 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/ips => generated 147 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:41.374759 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ea324219-f3b5-459d-bde4-24904f07364e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66156ff6-a00e-45fc-a904-68a0f6d0d6be"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:41.375918 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ea324219-f3b5-459d-bde4-24904f07364e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:41.381916 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea324219-f3b5-459d-bde4-24904f07364e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:41.382365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea324219-f3b5-459d-bde4-24904f07364e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:41.383144 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea324219-f3b5-459d-bde4-24904f07364e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:41.383574 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea324219-f3b5-459d-bde4-24904f07364e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:41.614550 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ea324219-f3b5-459d-bde4-24904f07364e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244621 May 10 15:08:41.615235 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 350/679] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:08:41 2022] POST /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:49.085701 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66156ff6-a00e-45fc-a904-68a0f6d0d6be"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:49.087529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:49.094128 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:49.094606 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:49.095370 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:49.095800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:49.170477 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Invalid volume: volume 66156ff6-a00e-45fc-a904-68a0f6d0d6be is already attached to instances: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: POST /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments HTTP/1.1 May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 74 May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:08:49.172135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {"volumeAttachment": {"volumeId": "66156ff6-a00e-45fc-a904-68a0f6d0d6be"}} May 10 15:08:49.173720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Invalid volume: volume 66156ff6-a00e-45fc-a904-68a0f6d0d6be is already attached to instances: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'server_id': 'b423901c-6ff6-4d8e-88fd-fc1fd3f4309b', 'body': {'volumeAttachment': {'volumeId': '66156ff6-a00e-45fc-a904-68a0f6d0d6be'}}} May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 66156ff6-a00e-45fc-a904-68a0f6d0d6be is already attached to instances: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:49.175431 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 66156ff6-a00e-45fc-a904-68a0f6d0d6be is already attached to instances: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:49.176960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 66156ff6-a00e-45fc-a904-68a0f6d0d6be is already attached to instances: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 400 to user: Invalid volume: volume 66156ff6-a00e-45fc-a904-68a0f6d0d6be is already attached to instances: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0797e6ba-0c49-49a2-8b49-afc012624237 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091866 May 10 15:08:49.178489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 330/680] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:08:49 2022] POST /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 15:08:49.234749 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:49.235331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:49.241370 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:49.241819 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:49.242617 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:49.243566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:49.320222 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lazy-loading 'services' on Instance uuid b423901c-6ff6-4d8e-88fd-fc1fd3f4309b {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:08:49.388443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-31943e06-97a9-405c-aa1f-7af576e88464 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments/66156ff6-a00e-45fc-a904-68a0f6d0d6be" status: 202 len: 0 microversion: 2.1 time: 0.158239 May 10 15:08:49.389043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 351/681] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:08:49 2022] DELETE /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments/66156ff6-a00e-45fc-a904-68a0f6d0d6be => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:08:49.398411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-47717d33-21d2-4033-9fc5-c304edddbf12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:49.399378 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-47717d33-21d2-4033-9fc5-c304edddbf12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:49.407171 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-47717d33-21d2-4033-9fc5-c304edddbf12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:49.407625 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-47717d33-21d2-4033-9fc5-c304edddbf12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:49.408558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-47717d33-21d2-4033-9fc5-c304edddbf12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:49.409400 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-47717d33-21d2-4033-9fc5-c304edddbf12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:49.441393 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-47717d33-21d2-4033-9fc5-c304edddbf12 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047824 May 10 15:08:49.441948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 331/682] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:08:49 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:50.454163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ce8da2c9-2c5a-4046-a160-0c5eac911554 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:50.455254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ce8da2c9-2c5a-4046-a160-0c5eac911554 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:50.461596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce8da2c9-2c5a-4046-a160-0c5eac911554 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:50.462586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce8da2c9-2c5a-4046-a160-0c5eac911554 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:50.463355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce8da2c9-2c5a-4046-a160-0c5eac911554 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:50.463796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce8da2c9-2c5a-4046-a160-0c5eac911554 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:50.491339 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ce8da2c9-2c5a-4046-a160-0c5eac911554 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041918 May 10 15:08:50.491892 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 352/683] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:08:50 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:08:50.546763 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:50.547292 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:50.553465 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:50.553913 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:50.554716 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:50.555154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:50.580528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:08:50.653208 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f12911de-7d1a-4647-bdf7-ba1c99f0ab34 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 204 len: 0 microversion: 2.1 time: 0.110089 May 10 15:08:50.653790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 332/684] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:08:50 2022] DELETE /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:08:50.661877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:50.662627 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:50.668565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:50.669012 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:50.669775 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:50.670217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:50.802202 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:50.809932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7e0b8f87-2c89-4576-86b2-a231a5d104a3 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1678 microversion: 2.1 time: 0.151983 May 10 15:08:50.810520 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 353/685] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:50 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:51.828211 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:51.828824 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:51.835032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:51.835479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:51.836233 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:51.837239 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:51.962805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:51.970004 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8c79c8b0-008a-4503-a788-43fcbf0a86ab tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1678 microversion: 2.1 time: 0.146045 May 10 15:08:51.970592 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 333/686] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:51 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:52.986601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:52.987144 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:52.993821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:52.994262 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:52.995048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:52.995476 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:53.124592 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:53.132022 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f82c1922-33ee-43fb-a61f-a3c9394bd078 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1678 microversion: 2.1 time: 0.149403 May 10 15:08:53.132623 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 354/687] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:52 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:54.088361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-2c89d70d-60d9-4a6b-aaf3-bdf95d353b81 req-571b2571-33a9-4636-b358-bfc047f1bcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b423901c-6ff6-4d8e-88fd-fc1fd3f4309b", "name": "network-vif-deleted", "tag": "ff51cc44-1439-4f2f-9f84-c17754faedc2"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:54.100335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-2c89d70d-60d9-4a6b-aaf3-bdf95d353b81 req-571b2571-33a9-4636-b358-bfc047f1bcc4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:54.100784 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-2c89d70d-60d9-4a6b-aaf3-bdf95d353b81 req-571b2571-33a9-4636-b358-bfc047f1bcc4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:54.112447 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-2c89d70d-60d9-4a6b-aaf3-bdf95d353b81 req-571b2571-33a9-4636-b358-bfc047f1bcc4 service nova] Creating event network-vif-deleted:ff51cc44-1439-4f2f-9f84-c17754faedc2 for instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b on hv-cinder-83962 May 10 15:08:54.117467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-2c89d70d-60d9-4a6b-aaf3-bdf95d353b81 req-571b2571-33a9-4636-b358-bfc047f1bcc4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040284 May 10 15:08:54.118263 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 334/688] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:54.152199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:54.152827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:54.161544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:54.162006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:54.162887 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:54.163499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:54.240800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:54.249730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ae0843d8-f225-46eb-a031-d88bd220dbda tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 200 len: 1326 microversion: 2.1 time: 0.104351 May 10 15:08:54.250904 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 355/689] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:54 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:55.268282 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:55.268975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:55.275635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:55.276082 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:55.276838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:55.277270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:55.291141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b HTTP/1.1 May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:08:55.292757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:08:55.294258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'b423901c-6ff6-4d8e-88fd-fc1fd3f4309b'} May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:08:55.295196 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:08:55.296782 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:08:55.298097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:08:55.298097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d9fc44f4-7ce9-4178-93d2-f5ff9e5df348 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 404 len: 111 microversion: 2.1 time: 0.030460 May 10 15:08:55.298097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 335/690] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:55 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 15:08:55.308541 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-53eb2218-dec3-4715-925c-5ec5206bbf38 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '.version_select at 0x7f7de5d1c3a0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:55.325530 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-53eb2218-dec3-4715-925c-5ec5206bbf38 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-412918471" status: 202 len: 0 microversion: 2.1 time: 0.022352 May 10 15:08:55.326088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 356/691] 10.222.0.83 () {58 vars in 1217 bytes} [Tue May 10 15:08:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-412918471 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:08:55.914865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6a616368-b64e-4849-9151-2791ea544925 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: .version_select at 0x7f7de5d0d820>, body: {"keypair": {"name": "tempest-keypair-1363901871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaSIyduw1jJI8epvkdGurVEENB9TPc/Gu7qyJm7R8LdUbNO37BjPwHv10+MLBeoMZZWmelh5OuyVXGBRmmi1UVh6jUzETp3O01zENiMV+LbZf05UT2Agmp3M5WV3qaffg=="}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:55.928562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-6a616368-b64e-4849-9151-2791ea544925 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:08:55.932939 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-6a616368-b64e-4849-9151-2791ea544925 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:08:55.954162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6a616368-b64e-4849-9151-2791ea544925 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043163 May 10 15:08:55.954788 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 336/692] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:08:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:08:57.122161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-166632803", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56419087-50d9-434c-b827-6ceec51e5c27"}], "security_groups": [{"name": "tempest-securitygroup--914647512"}], "key_name": "tempest-keypair-1363901871", "user_data": "}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:08:57.220660 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] validate_networks() for [('56419087-50d9-434c-b827-6ceec51e5c27', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:08:57.578708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:08:57.579172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:08:57.579841 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:08:57.580376 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:08:57.580842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:08:57.589422 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:57.589868 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:57.590706 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:57.591141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:57.609161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:08:57.613296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Getting quotas for user 06701ca6a5e0427c9d5b540133c522a0 and project 8961e0a1d6d443a0847533b83aa1ea8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:08:57.624763 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:08:57.627050 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:08:57.671262 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0f4430aa-6ea5-4b30-978f-2c3cd6f7b551 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.554698 May 10 15:08:57.671910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 357/693] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:08:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 15:08:57.682873 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e203003c-c96f-4826-8d95-13235460b89b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:57.683498 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e203003c-c96f-4826-8d95-13235460b89b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:57.737175 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e203003c-c96f-4826-8d95-13235460b89b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:57.744906 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e203003c-c96f-4826-8d95-13235460b89b tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1241 microversion: 2.1 time: 0.067038 May 10 15:08:57.745464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 337/694] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:57 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:58.762794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:58.763571 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:58.770742 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:58.771197 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:58.771983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:58.772422 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:58.947636 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:08:58.954784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d052d5c8-6171-4ed3-9f56-42c2d128f644 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1299 microversion: 2.1 time: 0.196948 May 10 15:08:58.955349 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 358/695] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:58 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:08:59.971257 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:08:59.971876 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:08:59.978919 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:59.979371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:08:59.980154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:08:59.980584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:00.132512 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:00.140773 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-476f58b6-5bce-4fce-bd0a-521b13a87c58 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1366 microversion: 2.1 time: 0.173273 May 10 15:09:00.141372 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 338/696] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:08:59 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:00.217467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-43fff5bb-5c9e-4fbe-bde4-30700ba34480 req-bedf60bc-5a74-4224-9800-a711a693bcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b3a64c-3f42-4c9e-93af-365cc96e737a", "tag": "8249c515-6b47-4c2d-96f0-3890fe222b3f"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:00.229434 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-43fff5bb-5c9e-4fbe-bde4-30700ba34480 req-bedf60bc-5a74-4224-9800-a711a693bcd9 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:00.229975 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-43fff5bb-5c9e-4fbe-bde4-30700ba34480 req-bedf60bc-5a74-4224-9800-a711a693bcd9 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:00.245216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-43fff5bb-5c9e-4fbe-bde4-30700ba34480 req-bedf60bc-5a74-4224-9800-a711a693bcd9 service nova] Creating event network-changed:8249c515-6b47-4c2d-96f0-3890fe222b3f for instance 66b3a64c-3f42-4c9e-93af-365cc96e737a on hv-cinder-83962 May 10 15:09:00.251578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-43fff5bb-5c9e-4fbe-bde4-30700ba34480 req-bedf60bc-5a74-4224-9800-a711a693bcd9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040447 May 10 15:09:00.252506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 359/697] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:01.158403 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:01.159018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:01.165499 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:01.165947 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:01.166730 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:01.167162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:01.293295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:01.300529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-73f221e6-56f5-4573-aa59-2a03be617092 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1366 microversion: 2.1 time: 0.146443 May 10 15:09:01.301096 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 339/698] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:01 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:02.317484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:02.318187 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:02.324760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:02.325216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:02.325981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:02.326624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:02.536659 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:02.544615 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b86d8b9f-cbd5-4c13-bb70-7dc5e5aba992 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1366 microversion: 2.1 time: 0.231313 May 10 15:09:02.545278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 360/699] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:02 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:03.561495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:03.562097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:03.568376 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:03.568830 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:03.569594 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:03.570035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:03.697455 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:03.704689 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ecb53ebd-1e74-43ff-910e-28623c02fd3e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1366 microversion: 2.1 time: 0.147081 May 10 15:09:03.705260 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 340/700] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:03 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:04.250789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-981e5c8e-2fb6-4228-a4cd-e359a87db24d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:04.251282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-981e5c8e-2fb6-4228-a4cd-e359a87db24d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:04.256984 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981e5c8e-2fb6-4228-a4cd-e359a87db24d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:04.257456 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981e5c8e-2fb6-4228-a4cd-e359a87db24d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:04.258902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981e5c8e-2fb6-4228-a4cd-e359a87db24d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:04.259335 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-981e5c8e-2fb6-4228-a4cd-e359a87db24d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:04.281153 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-981e5c8e-2fb6-4228-a4cd-e359a87db24d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/ips" status: 200 len: 152 microversion: 2.20 time: 0.081818 May 10 15:09:04.281703 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 361/701] 10.222.0.83 () {60 vars in 1288 bytes} [Tue May 10 15:09:04 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/ips => generated 152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:09:04.711199 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-dc6fb68a-c696-4d44-a5bc-da1db8a960e0 req-4ec465ed-ee9e-429d-9ab9-d7fc2a5a52da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b3a64c-3f42-4c9e-93af-365cc96e737a", "name": "network-vif-plugged", "status": "completed", "tag": "8249c515-6b47-4c2d-96f0-3890fe222b3f"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:04.720787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-dc6fb68a-c696-4d44-a5bc-da1db8a960e0 req-4ec465ed-ee9e-429d-9ab9-d7fc2a5a52da service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:04.720911 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:04.721358 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-dc6fb68a-c696-4d44-a5bc-da1db8a960e0 req-4ec465ed-ee9e-429d-9ab9-d7fc2a5a52da service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:04.721497 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:04.727894 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:04.728350 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:04.729123 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:04.729567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:04.733654 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-dc6fb68a-c696-4d44-a5bc-da1db8a960e0 req-4ec465ed-ee9e-429d-9ab9-d7fc2a5a52da service nova] Creating event network-vif-plugged:8249c515-6b47-4c2d-96f0-3890fe222b3f for instance 66b3a64c-3f42-4c9e-93af-365cc96e737a on hv-cinder-83962 May 10 15:09:04.738781 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-dc6fb68a-c696-4d44-a5bc-da1db8a960e0 req-4ec465ed-ee9e-429d-9ab9-d7fc2a5a52da service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088051 May 10 15:09:04.739531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 341/702] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:04.865097 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:04.874380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-81b31c12-fe61-46e4-b11c-780797cfeb0e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1366 microversion: 2.1 time: 0.157119 May 10 15:09:04.875181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 362/703] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:04 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:09:05.891781 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:05.892507 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:05.898566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:05.899015 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:05.899770 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:05.900208 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:06.025338 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:06.032530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-252620d9-40f7-4b7a-a499-30a0dc627dec tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1366 microversion: 2.1 time: 0.145432 May 10 15:09:06.033101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 342/704] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:05 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:06.408547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:06.409083 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:06.415963 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:06.416414 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:06.417177 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:06.417616 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:06.439336 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lazy-loading 'flavor' on Instance uuid b4b73b3a-5044-4050-9df7-63449017d71b {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:09:06.691499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ae63a3d7-873a-4e03-a9cd-fc090d5ea22e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/action" status: 202 len: 0 microversion: 2.20 time: 0.286655 May 10 15:09:06.692113 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 363/705] 10.222.0.83 () {62 vars in 1318 bytes} [Tue May 10 15:09:06 2022] POST /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 15:09:06.700103 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:06.700704 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:06.706589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:06.707074 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:06.707994 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:06.708452 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:06.834282 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:06.842645 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:06.844147 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:06.845299 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-060da4b2-476a-48d1-b4e1-262bdc6ed7a5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.148988 May 10 15:09:06.845873 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 343/706] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:06 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:07.049591 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:07.050302 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:07.056494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:07.056952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:07.057723 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:07.058161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:07.186696 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:07.194040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8067fd86-086e-4e8d-928c-b9864f1574d0 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1554 microversion: 2.1 time: 0.148764 May 10 15:09:07.194640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 364/707] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:07 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:07.210361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a928802f-fe75-490d-8067-37e5fc18b265 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:07.210866 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a928802f-fe75-490d-8067-37e5fc18b265 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:07.217136 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a928802f-fe75-490d-8067-37e5fc18b265 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:07.217584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a928802f-fe75-490d-8067-37e5fc18b265 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:07.218344 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a928802f-fe75-490d-8067-37e5fc18b265 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:07.218818 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a928802f-fe75-490d-8067-37e5fc18b265 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:07.296590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a928802f-fe75-490d-8067-37e5fc18b265 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089930 May 10 15:09:07.297189 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 344/708] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:09:07 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:07.863637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:07.864270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:07.870629 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:07.871081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:07.872085 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:07.872524 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:08.008868 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:08.016778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:08.018260 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:08.019429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-dea3674d-12ae-481e-92a7-e8ed7b971825 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.159782 May 10 15:09:08.020002 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 365/709] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:07 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:08.301338 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-9ad31457-4c50-454d-8b68-abf8890b12f7 req-f2cacf9c-1662-4196-bf36-187fe6ef1b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b3a64c-3f42-4c9e-93af-365cc96e737a", "tag": "8249c515-6b47-4c2d-96f0-3890fe222b3f"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:08.310076 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9ad31457-4c50-454d-8b68-abf8890b12f7 req-f2cacf9c-1662-4196-bf36-187fe6ef1b22 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:08.310555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9ad31457-4c50-454d-8b68-abf8890b12f7 req-f2cacf9c-1662-4196-bf36-187fe6ef1b22 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:08.321485 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-9ad31457-4c50-454d-8b68-abf8890b12f7 req-f2cacf9c-1662-4196-bf36-187fe6ef1b22 service nova] Creating event network-changed:8249c515-6b47-4c2d-96f0-3890fe222b3f for instance 66b3a64c-3f42-4c9e-93af-365cc96e737a on hv-cinder-83962 May 10 15:09:08.326313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-9ad31457-4c50-454d-8b68-abf8890b12f7 req-f2cacf9c-1662-4196-bf36-187fe6ef1b22 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080685 May 10 15:09:08.326945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 345/710] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:08.709658 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:08.710157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:08.716715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:08.717174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:08.718065 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:08.718546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:08.800520 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lazy-loading 'services' on Instance uuid b05c7bca-c0fc-42f3-8561-19dd08b84581 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:09:08.882736 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-fc5aa3b8-4155-4f2b-b851-4c858caeb000 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments/77267a0c-57bd-40c9-adfa-81252eafe318" status: 202 len: 0 microversion: 2.1 time: 0.175954 May 10 15:09:08.887547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 366/711] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:09:08 2022] DELETE /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments/77267a0c-57bd-40c9-adfa-81252eafe318 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:09:08.892801 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bf64d6d5-a23e-4c22-9fd2-5db541a6ed7f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:08.893764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bf64d6d5-a23e-4c22-9fd2-5db541a6ed7f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:08.900570 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf64d6d5-a23e-4c22-9fd2-5db541a6ed7f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:08.901022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf64d6d5-a23e-4c22-9fd2-5db541a6ed7f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:08.901791 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf64d6d5-a23e-4c22-9fd2-5db541a6ed7f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:08.902222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bf64d6d5-a23e-4c22-9fd2-5db541a6ed7f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:08.944091 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bf64d6d5-a23e-4c22-9fd2-5db541a6ed7f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055763 May 10 15:09:08.944562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 346/712] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:09:08 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:09.038088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:09.039154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:09.045325 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:09.045779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:09.046583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:09.047022 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:09.181519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:09.189596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:09.191143 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:09.192323 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-075f2acd-abb4-4237-a5e6-837f97806b1c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.158586 May 10 15:09:09.192895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 367/713] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:09 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:09.955620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1f27fd61-7ce6-4bff-ade0-677e7b33c9f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:09.956471 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1f27fd61-7ce6-4bff-ade0-677e7b33c9f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:09.962751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f27fd61-7ce6-4bff-ade0-677e7b33c9f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:09.963227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f27fd61-7ce6-4bff-ade0-677e7b33c9f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:09.963982 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f27fd61-7ce6-4bff-ade0-677e7b33c9f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:09.964413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1f27fd61-7ce6-4bff-ade0-677e7b33c9f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:09.991859 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1f27fd61-7ce6-4bff-ade0-677e7b33c9f0 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040265 May 10 15:09:09.993060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 347/714] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:09:09 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 15:09:10.064042 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:10.064658 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:10.070911 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:10.071357 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:10.072110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:10.072541 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:10.098071 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:09:10.171980 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b75cb017-ead9-4d01-9179-384ce5250445 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 204 len: 0 microversion: 2.1 time: 0.111442 May 10 15:09:10.172671 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 368/715] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:09:10 2022] DELETE /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:09:10.180741 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:10.181362 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:10.187260 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:10.187714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:10.188491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:10.188931 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:10.214110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:10.214757 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:10.220892 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:10.221336 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:10.222106 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:10.222577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:10.318760 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:10.326266 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fb2ef5d4-1940-4451-8bfd-00816dc26880 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1691 microversion: 2.1 time: 0.149614 May 10 15:09:10.326888 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 348/716] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:10 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:10.355928 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:10.363710 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:10.365190 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:10.366359 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2f1dd8e2-b203-4b50-8cec-136e2b35df6d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.157096 May 10 15:09:10.366933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 369/717] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:10 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:11.343081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:11.343808 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:11.350122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:11.350614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:11.351381 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:11.351837 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:11.385277 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:11.385977 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:11.392605 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:11.393149 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:11.393933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:11.394364 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:11.480879 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:11.488121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-56132a31-acbc-4b51-a1e0-5afa6587b420 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1691 microversion: 2.1 time: 0.148883 May 10 15:09:11.488697 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 349/718] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:11 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:11.522565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:11.530876 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:11.532367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:11.533495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8ea3bb5c-70dc-41fe-85ce-c4d5ab0a51ad tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.152638 May 10 15:09:11.534050 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 370/719] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:11 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:09:12.505231 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:12.505839 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:12.512116 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:12.512564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:12.513325 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:12.513759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:12.551229 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:12.551834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:12.558320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:12.558797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:12.559568 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:12.560000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:12.641249 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:12.649054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a7138635-bab6-417c-86ae-64c6912b1f1d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1691 microversion: 2.1 time: 0.147146 May 10 15:09:12.649629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 350/720] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:12 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:12.685640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:12.693265 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:12.694780 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:12.695929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-90a29f2e-1c97-4567-bcd5-c3e893925fc3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.148457 May 10 15:09:12.696482 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 371/721] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:12 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:09:13.665469 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:13.666073 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:13.672317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:13.672762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:13.673512 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:13.673941 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:13.712851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:13.713651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:13.720031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:13.720483 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:13.721256 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:13.721716 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:13.802097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:13.810111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6c3b3e31-7e1c-4fb0-84b9-19bbcd810930 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1691 microversion: 2.1 time: 0.148908 May 10 15:09:13.810948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 351/722] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:13 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:13.857372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:13.864977 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:13.866486 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:13.868250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d2cef70d-d10c-4611-be31-3331d39b46b1 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.159228 May 10 15:09:13.868812 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 372/723] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:13 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:09:14.827178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:14.827788 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:14.834075 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:14.834558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:14.835314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:14.835751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:14.888468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:14.889386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:14.896036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:14.897183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:14.897974 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:14.898539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:14.971822 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:14.979447 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6b48170f-4f8f-43df-b71e-602414783cbb tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 200 len: 1691 microversion: 2.1 time: 0.156115 May 10 15:09:14.980128 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 352/724] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:14 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:15.163260 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:15.171857 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:15.173505 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:15.174685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2513e3ab-01db-4330-bc47-b4b669b40244 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.291751 May 10 15:09:15.175255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 373/725] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:14 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:09:15.342648 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-1595eae5-aff7-496b-a828-b473e15ee273 req-214e4748-560d-4fcd-a89a-621d572af306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05c7bca-c0fc-42f3-8561-19dd08b84581", "name": "network-vif-deleted", "tag": "ea78e5d2-ebba-4237-9401-0a7bce6e10b9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:15.352547 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-1595eae5-aff7-496b-a828-b473e15ee273 req-214e4748-560d-4fcd-a89a-621d572af306 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:15.353000 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-1595eae5-aff7-496b-a828-b473e15ee273 req-214e4748-560d-4fcd-a89a-621d572af306 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:15.373801 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-1595eae5-aff7-496b-a828-b473e15ee273 req-214e4748-560d-4fcd-a89a-621d572af306 service nova] Creating event network-vif-deleted:ea78e5d2-ebba-4237-9401-0a7bce6e10b9 for instance b05c7bca-c0fc-42f3-8561-19dd08b84581 on hv-cinder-83962 May 10 15:09:15.379760 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-1595eae5-aff7-496b-a828-b473e15ee273 req-214e4748-560d-4fcd-a89a-621d572af306 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040743 May 10 15:09:15.380389 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 353/726] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:15.995795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:15.996390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: b05c7bca-c0fc-42f3-8561-19dd08b84581] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:16.002984 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:16.003367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:16.004126 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:16.004566 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:16.020522 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] HTTP exception thrown: Instance b05c7bca-c0fc-42f3-8561-19dd08b84581 could not be found. May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Request method failure captured: May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 HTTP/1.1 May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6lGI9oNd8c6_-54gyQ9qygpcyZVzBMrZGY5krraBhjSheFh_7mV52JYu0SKpGeICkITYh6gJdMWTAKknV_0ZJKuf7n29qMlO0glIoiz8wNfWZfusvZgEb5DfBbKDG_Kv4wARTGsyY81ZxDRPnvm-MT6v8Phg8x5BC5x59at72EcIM May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:09:16.022288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: e690e810cdb54431af33651d13272239 May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance b05c7bca-c0fc-42f3-8561-19dd08b84581 could not be found. May 10 15:09:16.024584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'b05c7bca-c0fc-42f3-8561-19dd08b84581'} May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05c7bca-c0fc-42f3-8561-19dd08b84581 could not be found. May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:16.025506 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05c7bca-c0fc-42f3-8561-19dd08b84581 could not be found. May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05c7bca-c0fc-42f3-8561-19dd08b84581 could not be found. May 10 15:09:16.030034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:16.031463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Returning 404 to user: Instance b05c7bca-c0fc-42f3-8561-19dd08b84581 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:16.031463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-acd39243-a002-423b-a51e-e938594f3009 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581" status: 404 len: 111 microversion: 2.1 time: 0.033269 May 10 15:09:16.031463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 374/727] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:15 2022] GET /compute/v2.1/servers/b05c7bca-c0fc-42f3-8561-19dd08b84581 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:09:16.035089 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b4be5400-5746-4746-b0da-b338f363735d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '.version_select at 0x7f7de0c2e0d0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:16.051731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b4be5400-5746-4746-b0da-b338f363735d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512138781" status: 202 len: 0 microversion: 2.1 time: 0.021361 May 10 15:09:16.052350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 354/728] 10.222.0.83 () {58 vars in 1220 bytes} [Tue May 10 15:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512138781 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:09:16.193112 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:16.193749 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:16.200726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:16.201179 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:16.202133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:16.202608 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:16.470309 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:16.480631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:16.482470 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:16.483710 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-42e5f464-bd40-4625-821f-5308da49ffb6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.294432 May 10 15:09:16.484345 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 375/729] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:16 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:17.502757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:17.503533 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:17.510659 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:17.511105 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:17.511861 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:17.512292 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:17.869257 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:17.877758 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:17.879382 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:17.880667 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-111b7ac4-b14a-4152-8a9d-5b55dedf6b77 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.382442 May 10 15:09:17.881313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 355/730] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:17 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:18.899530 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:18.900123 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:18.906069 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:18.906553 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:18.907310 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:18.907741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:18.997335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:18.998429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:19.004617 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:19.005065 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:19.005828 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:19.006258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:19.030432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:09:19.039994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:19.047792 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:19.049317 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:19.050494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5ea414cf-ad5a-4fac-a64b-9aebdde2f079 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.154786 May 10 15:09:19.051058 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 376/731] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:18 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:19.104440 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-430de5bb-6d7a-463a-b0b9-95afa2948f6a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "DELETE /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 204 len: 0 microversion: 2.1 time: 0.110822 May 10 15:09:19.105123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 356/732] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:09:18 2022] DELETE /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 15:09:19.114275 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:19.115077 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:19.121578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:19.122300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:19.123157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:19.123591 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:19.249150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:19.256427 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d223cebd-ff59-4f40-ace2-a5b2f72b4c4a tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1506 microversion: 2.1 time: 0.147079 May 10 15:09:19.256997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 377/733] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:19 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:09:20.069565 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:20.070886 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:20.077122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:20.077564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:20.078319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:20.078775 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:20.202717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:20.210274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:20.211785 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:20.212945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0230bd3e-8862-4e41-95a7-dc992c9eb364 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.147640 May 10 15:09:20.213503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 357/734] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:20 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:20.272824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:20.273504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:20.279818 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:20.280329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:20.281093 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:20.281528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:20.408054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:20.415788 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-36e689a9-5c3d-4d9b-8470-991ff111186e tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1506 microversion: 2.1 time: 0.146762 May 10 15:09:20.416360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 378/735] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:20 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:21.231800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:21.232407 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:21.238829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:21.239271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:21.240029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:21.240456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:21.369810 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:21.379216 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:21.380787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:21.381983 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2f06a08d-e30c-4bc9-91f1-fd49715ea960 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.154016 May 10 15:09:21.382577 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 358/736] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:21 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:21.436858 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:21.440010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:21.449048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:21.450425 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:21.450941 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:21.451378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:21.487624 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-a7ead40b-d30b-476e-b910-18952a43c156 req-9804f64e-4674-40aa-9e5e-93e4cb5367c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804e466b-083e-47d5-8597-ab3ed5d5dc72", "name": "network-vif-deleted", "tag": "8d7f4ee8-d8cb-4edb-8b63-e09306e199a4"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:21.498853 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-a7ead40b-d30b-476e-b910-18952a43c156 req-9804f64e-4674-40aa-9e5e-93e4cb5367c4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:21.499300 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-a7ead40b-d30b-476e-b910-18952a43c156 req-9804f64e-4674-40aa-9e5e-93e4cb5367c4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:21.514226 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-a7ead40b-d30b-476e-b910-18952a43c156 req-9804f64e-4674-40aa-9e5e-93e4cb5367c4 service nova] Creating event network-vif-deleted:8d7f4ee8-d8cb-4edb-8b63-e09306e199a4 for instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 on hv-cinder-83962 May 10 15:09:21.519995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:21.520687 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-a7ead40b-d30b-476e-b910-18952a43c156 req-9804f64e-4674-40aa-9e5e-93e4cb5367c4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037372 May 10 15:09:21.521506 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 359/737] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:21.528189 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8412bafc-f0d0-4bbf-8b79-6e35f2f8c4e9 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 200 len: 1464 microversion: 2.1 time: 0.095230 May 10 15:09:21.529001 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 379/738] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:21 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 1464 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:22.401234 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:22.401927 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:22.408447 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.408890 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.409678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.410108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.545666 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:22.546150 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:22.546286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 804e466b-083e-47d5-8597-ab3ed5d5dc72] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:22.552527 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.552979 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.553752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.553874 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:22.554186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.556071 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:22.557227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4498bd58-dcc1-4d0e-9dc1-fe4e474aa7a3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.160237 May 10 15:09:22.557787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 360/739] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:22 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:22.567998 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] HTTP exception thrown: Instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 could not be found. May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Request method failure captured: May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 HTTP/1.1 May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6lGI9oNd8c6_-54gyQ9qygpcyZVzBMrZGY5krraBhjSheFh_7mV52JYu0SKpGeICkITYh6gJdMWTAKknV_0ZJKuf7n29qMlO0glIoiz8wNfWZfusvZgEb5DfBbKDG_Kv4wARTGsyY81ZxDRPnvm-MT6v8Phg8x5BC5x59at72EcIM May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:09:22.569544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: e690e810cdb54431af33651d13272239 May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 could not be found. May 10 15:09:22.571122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '804e466b-083e-47d5-8597-ab3ed5d5dc72'} May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 could not be found. May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:22.571925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 could not be found. May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 could not be found. May 10 15:09:22.573096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:22.574184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Returning 404 to user: Instance 804e466b-083e-47d5-8597-ab3ed5d5dc72 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:22.574184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-dea95674-1a7e-4a4b-8b1d-ac5514d92e47 tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72" status: 404 len: 111 microversion: 2.1 time: 0.029275 May 10 15:09:22.574184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 380/740] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:22 2022] GET /compute/v2.1/servers/804e466b-083e-47d5-8597-ab3ed5d5dc72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 15:09:22.580355 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:22.580891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:22.587310 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.587758 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.588548 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.588979 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.612790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:09:22.688717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d791d292-5044-4338-b81e-4b2ecc491ced tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "DELETE /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 204 len: 0 microversion: 2.1 time: 0.112685 May 10 15:09:22.692774 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 361/741] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:09:22 2022] DELETE /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:09:22.699676 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:22.700579 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:22.706343 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.706823 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.707575 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:22.708014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:22.836458 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:22.843620 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6cfff7d2-ff70-4f27-9819-25cb5ff6300d tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.149575 May 10 15:09:22.844187 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 381/742] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:22 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:23.576545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:23.577247 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:23.583777 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:23.584221 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:23.584985 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:23.585421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:23.710502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:23.718258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:23.719786 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:23.720941 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-12d73255-49fc-48a3-b0fe-cd8f564e8385 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.148722 May 10 15:09:23.721502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 362/743] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:23 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:23.860962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:23.861572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:23.868743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:23.869279 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:23.870141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:23.870604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:23.997801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:24.005240 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4e26a63e-5d6c-413a-b6e8-03c9755bcafc tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.148049 May 10 15:09:24.005812 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 382/744] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:23 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:24.738483 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:24.739076 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:24.747111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:24.747566 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:24.748328 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:24.748758 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:24.875774 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:24.883922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:24.885444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:24.886607 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f9713ba2-9324-41a4-ba56-968dceb915c8 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.152048 May 10 15:09:24.887173 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 363/745] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:24 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:25.022043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:25.022626 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:25.029432 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:25.029882 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:25.030680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:25.031120 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:25.160166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e690e810cdb54431af33651d13272239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd851fe67b7e940f9b20979bdd619bf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:25.167539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-179d1b47-c299-46dc-aced-167b695b765f tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 200 len: 1521 microversion: 2.1 time: 0.149391 May 10 15:09:25.168108 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 383/746] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:25 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:09:25.655776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-38fe3782-dfd1-4be4-a34d-17b3a7d513c7 req-26783a36-5233-4c6c-8a34-9ca0de44a01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975ddad8-93eb-4cca-8d23-8de0f4637aea", "name": "network-vif-deleted", "tag": "a75854b9-6524-4136-8cff-d2d61e26eec6"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:25.664399 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-38fe3782-dfd1-4be4-a34d-17b3a7d513c7 req-26783a36-5233-4c6c-8a34-9ca0de44a01d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:25.665373 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-38fe3782-dfd1-4be4-a34d-17b3a7d513c7 req-26783a36-5233-4c6c-8a34-9ca0de44a01d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:25.677017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-38fe3782-dfd1-4be4-a34d-17b3a7d513c7 req-26783a36-5233-4c6c-8a34-9ca0de44a01d service nova] Creating event network-vif-deleted:a75854b9-6524-4136-8cff-d2d61e26eec6 for instance 975ddad8-93eb-4cca-8d23-8de0f4637aea on hv-cinder-83962 May 10 15:09:25.683719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-38fe3782-dfd1-4be4-a34d-17b3a7d513c7 req-26783a36-5233-4c6c-8a34-9ca0de44a01d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031190 May 10 15:09:25.684011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 364/747] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:25.905648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:25.906206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:25.912137 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:25.912590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:25.913392 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:25.913832 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:26.054779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:26.064698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:26.066976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:26.068175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b6b6925f-edf0-4a1b-a059-5e17d973efd0 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.166489 May 10 15:09:26.078753 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 384/748] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:25 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:26.185316 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:26.185916 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] [instance: 975ddad8-93eb-4cca-8d23-8de0f4637aea] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:26.191962 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:26.192417 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:26.193178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:26.193620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:26.206378 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] HTTP exception thrown: Instance 975ddad8-93eb-4cca-8d23-8de0f4637aea could not be found. May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Request method failure captured: May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea HTTP/1.1 May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6lGI9oNd8c6_-54gyQ9qygpcyZVzBMrZGY5krraBhjSheFh_7mV52JYu0SKpGeICkITYh6gJdMWTAKknV_0ZJKuf7n29qMlO0glIoiz8wNfWZfusvZgEb5DfBbKDG_Kv4wARTGsyY81ZxDRPnvm-MT6v8Phg8x5BC5x59at72EcIM May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:09:26.207988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d851fe67b7e940f9b20979bdd619bf48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: d851fe67b7e940f9b20979bdd619bf48 May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1479456202 May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: e690e810cdb54431af33651d13272239 May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1479456202-project May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 975ddad8-93eb-4cca-8d23-8de0f4637aea could not be found. May 10 15:09:26.209531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '975ddad8-93eb-4cca-8d23-8de0f4637aea'} May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975ddad8-93eb-4cca-8d23-8de0f4637aea could not be found. May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:26.210556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975ddad8-93eb-4cca-8d23-8de0f4637aea could not be found. May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975ddad8-93eb-4cca-8d23-8de0f4637aea could not be found. May 10 15:09:26.212571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:26.213993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] Returning 404 to user: Instance 975ddad8-93eb-4cca-8d23-8de0f4637aea could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:26.213993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1c56fe65-1958-4e16-8d17-c3787992fc1c tempest-ServerRescueNegativeTestJSON-1479456202 tempest-ServerRescueNegativeTestJSON-1479456202-project] 10.222.0.83 "GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea" status: 404 len: 111 microversion: 2.1 time: 0.028862 May 10 15:09:26.213993 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 365/749] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:09:26 2022] GET /compute/v2.1/servers/975ddad8-93eb-4cca-8d23-8de0f4637aea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:09:27.086216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:27.086896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:27.093150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:27.093605 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:27.094367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:27.094827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:27.331398 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:27.339045 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:27.340574 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:27.341795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-171672a5-2eb3-4de2-ad4f-378cce116c0e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.259417 May 10 15:09:27.342360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 385/750] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:27 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:28.360045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:28.360717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:28.367671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:28.369049 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:28.370070 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:28.370753 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:28.514666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:28.524645 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:28.526586 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:28.527758 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5bc2f79d-764c-4511-a86f-eca7e280dba3 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1745 microversion: 2.20 time: 0.171722 May 10 15:09:28.528316 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 366/751] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:28 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:29.545306 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:29.545941 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:29.562033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:29.566314 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:29.567159 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:29.567525 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:29.704599 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:29.715136 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:29.716948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:29.718213 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-011116e7-c961-42cd-af61-749a9cac704e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1745 microversion: 2.20 time: 0.176989 May 10 15:09:29.718853 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 386/752] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:29 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:30.739451 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:30.740060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:30.752148 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:30.752762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:30.756891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:30.757583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:30.927223 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:30.941920 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:30.945135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:30.946733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0f69dae5-8845-40fa-b83b-14e65f40b908 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.213581 May 10 15:09:30.957627 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 367/753] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:30 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:30.999379 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1d18492b-e867-4fb0-9ab7-985f21c03e0c tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Action: 'create', calling method: .version_select at 0x7f7de0d00550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-743810326", "metadata": {"Type": "work"}}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1d18492b-e867-4fb0-9ab7-985f21c03e0c tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Request method failure captured: May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 121 May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoAqdMa-stm4_-RhAhS72vsWus0-s3329uHwomlXG0D2c4cDsCWovSTtWfl84cAoN4OLLCH0-gWyAMGFlISyUxQ4wzxwAjuQ3Ro5uvAAkgXbzmNEfsE8O1tszXcX0ZLbetXOffismin8Gg3E-U8Bzud3Yxs9gT-N-tXicoIKxysvIuc May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:09:31.015771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13903400ae4744c6aab71bda83e84118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 104c29b17a454c95ae38fd37c692e1de May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-743810326", "metadata": {"Type": "work"}}} May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:09:31.017493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-743810326', 'metadata': {'Type': 'work'}}}} May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise error May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi '#$%' May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:31.018558 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 15:09:31.020193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 15:09:31.021494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 15:09:31.021494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.021494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1d18492b-e867-4fb0-9ab7-985f21c03e0c tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:31.021494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1d18492b-e867-4fb0-9ab7-985f21c03e0c tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.265399 May 10 15:09:31.021494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 387/754] 10.222.0.83 () {60 vars in 1155 bytes} [Tue May 10 15:09:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 15:09:31.033717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0b884ad0-cddd-4e17-9608-4e4fb764909e tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Action: 'create', calling method: .version_select at 0x7f7de5c76550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1089918098", "metadata": {"Type": "work"}}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0b884ad0-cddd-4e17-9608-4e4fb764909e tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Request method failure captured: May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 120 May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoAqdMa-stm4_-RhAhS72vsWus0-s3329uHwomlXG0D2c4cDsCWovSTtWfl84cAoN4OLLCH0-gWyAMGFlISyUxQ4wzxwAjuQ3Ro5uvAAkgXbzmNEfsE8O1tszXcX0ZLbetXOffismin8Gg3E-U8Bzud3Yxs9gT-N-tXicoIKxysvIuc May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:09:31.038250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13903400ae4744c6aab71bda83e84118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 104c29b17a454c95ae38fd37c692e1de May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1089918098", "metadata": {"Type": "work"}}} May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: May 10 15:09:31.040405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1089918098', 'metadata': {'Type': 'work'}}}} May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise error May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi '0' May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:31.041353 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 15:09:31.043108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 15:09:31.045005 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 15:09:31.045005 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.046229 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0b884ad0-cddd-4e17-9608-4e4fb764909e tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:31.047287 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0b884ad0-cddd-4e17-9608-4e4fb764909e tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018834 May 10 15:09:31.047894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 368/755] 10.222.0.83 () {60 vars in 1155 bytes} [Tue May 10 15:09:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 15:09:31.059618 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dbb38070-6403-4b34-b2f7-3b26193aea57 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Action: 'create', calling method: .version_select at 0x7f7de5d31790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1991711501", "metadata": {"Type": "work"}}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dbb38070-6403-4b34-b2f7-3b26193aea57 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Request method failure captured: May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 119 May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoAqdMa-stm4_-RhAhS72vsWus0-s3329uHwomlXG0D2c4cDsCWovSTtWfl84cAoN4OLLCH0-gWyAMGFlISyUxQ4wzxwAjuQ3Ro5uvAAkgXbzmNEfsE8O1tszXcX0ZLbetXOffismin8Gg3E-U8Bzud3Yxs9gT-N-tXicoIKxysvIuc May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:09:31.062383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13903400ae4744c6aab71bda83e84118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 104c29b17a454c95ae38fd37c692e1de May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1991711501", "metadata": {"Type": "work"}}} May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:09:31.063981 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1991711501', 'metadata': {'Type': 'work'}}}} May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise error May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi '' May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:31.064851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 15:09:31.066403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 15:09:31.067698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 15:09:31.067698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.067698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dbb38070-6403-4b34-b2f7-3b26193aea57 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:31.067698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-dbb38070-6403-4b34-b2f7-3b26193aea57 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009490 May 10 15:09:31.067698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 388/756] 10.222.0.83 () {60 vars in 1155 bytes} [Tue May 10 15:09:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 15:09:31.075029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-09c3da77-76f9-4ba8-8d78-5ec8ce9e5d81 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Calling method '.version_select at 0x7f7de5d8f550>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:31.107530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-09c3da77-76f9-4ba8-8d78-5ec8ce9e5d81 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] HTTP exception thrown: Volume tempest-invalid-72949094 could not be found. May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-09c3da77-76f9-4ba8-8d78-5ec8ce9e5d81 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Request method failure captured: May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-72949094 HTTP/1.1 May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoAqdMa-stm4_-RhAhS72vsWus0-s3329uHwomlXG0D2c4cDsCWovSTtWfl84cAoN4OLLCH0-gWyAMGFlISyUxQ4wzxwAjuQ3Ro5uvAAkgXbzmNEfsE8O1tszXcX0ZLbetXOffismin8Gg3E-U8Bzud3Yxs9gT-N-tXicoIKxysvIuc May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:09:31.112077 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13903400ae4744c6aab71bda83e84118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 104c29b17a454c95ae38fd37c692e1de May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Volume tempest-invalid-72949094 could not be found. May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'tempest-invalid-72949094'} May 10 15:09:31.113671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-72949094 could not be found. (HTTP 404) (Request-ID: req-c1c0b41a-ec0e-43ad-9f77-97720ed1dc50) May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.118672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 15:09:31.120641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-72949094 could not be found. May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:09:31.122317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-72949094 could not be found. May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-72949094 could not be found. May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-09c3da77-76f9-4ba8-8d78-5ec8ce9e5d81 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Returning 404 to user: Volume tempest-invalid-72949094 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-09c3da77-76f9-4ba8-8d78-5ec8ce9e5d81 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-72949094" status: 404 len: 97 microversion: 2.1 time: 0.042409 May 10 15:09:31.123802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 369/757] 10.222.0.83 () {58 vars in 1211 bytes} [Tue May 10 15:09:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-72949094 => generated 97 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 15:09:31.130587 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c4de4ff7-7e49-40c1-ba72-c17e3b6571c1 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003747 May 10 15:09:31.131099 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 389/758] 10.222.0.83 () {58 vars in 1139 bytes} [Tue May 10 15:09:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 15:09:31.139978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a071a162-4d7d-4b81-8ce0-51d3d63a6d58 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003829 May 10 15:09:31.141125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 370/759] 10.222.0.83 () {58 vars in 1136 bytes} [Tue May 10 15:09:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 15:09:31.150789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9d81909d-cc5c-4615-ad3f-98b47d0866f4 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Calling method '.version_select at 0x7f7de0d2a280>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:31.182302 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-9d81909d-cc5c-4615-ad3f-98b47d0866f4 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] HTTP exception thrown: Volume 4a71e7f8-83e1-42f4-85cd-15029905ace6 could not be found. May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9d81909d-cc5c-4615-ad3f-98b47d0866f4 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Request method failure captured: May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: DELETE /compute/v2.1/os-volumes/4a71e7f8-83e1-42f4-85cd-15029905ace6 HTTP/1.1 May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoAqdMa-stm4_-RhAhS72vsWus0-s3329uHwomlXG0D2c4cDsCWovSTtWfl84cAoN4OLLCH0-gWyAMGFlISyUxQ4wzxwAjuQ3Ro5uvAAkgXbzmNEfsE8O1tszXcX0ZLbetXOffismin8Gg3E-U8Bzud3Yxs9gT-N-tXicoIKxysvIuc May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:09:31.184395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13903400ae4744c6aab71bda83e84118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 104c29b17a454c95ae38fd37c692e1de May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Volume 4a71e7f8-83e1-42f4-85cd-15029905ace6 could not be found. May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '4a71e7f8-83e1-42f4-85cd-15029905ace6'} May 10 15:09:31.188719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a71e7f8-83e1-42f4-85cd-15029905ace6 could not be found. (HTTP 404) (Request-ID: req-7f5b0e8f-8de3-4428-b455-935c623e1208) May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.190248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 15:09:31.193511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a71e7f8-83e1-42f4-85cd-15029905ace6 could not be found. May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 15:09:31.195893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a71e7f8-83e1-42f4-85cd-15029905ace6 could not be found. May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a71e7f8-83e1-42f4-85cd-15029905ace6 could not be found. May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9d81909d-cc5c-4615-ad3f-98b47d0866f4 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Returning 404 to user: Volume 4a71e7f8-83e1-42f4-85cd-15029905ace6 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9d81909d-cc5c-4615-ad3f-98b47d0866f4 tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/4a71e7f8-83e1-42f4-85cd-15029905ace6" status: 404 len: 109 microversion: 2.1 time: 0.040303 May 10 15:09:31.197485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 390/760] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:09:31 2022] DELETE /compute/v2.1/os-volumes/4a71e7f8-83e1-42f4-85cd-15029905ace6 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:09:31.204422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-070ca864-64cf-4f89-9ab8-9a479f669f3a tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Calling method '.version_select at 0x7f7de5c76700>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:31.232465 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-070ca864-64cf-4f89-9ab8-9a479f669f3a tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] HTTP exception thrown: Volume 49e0a622-716d-4171-ad71-b85da6d35b38 could not be found. May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-070ca864-64cf-4f89-9ab8-9a479f669f3a tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Request method failure captured: May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/os-volumes/49e0a622-716d-4171-ad71-b85da6d35b38 HTTP/1.1 May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoAqdMa-stm4_-RhAhS72vsWus0-s3329uHwomlXG0D2c4cDsCWovSTtWfl84cAoN4OLLCH0-gWyAMGFlISyUxQ4wzxwAjuQ3Ro5uvAAkgXbzmNEfsE8O1tszXcX0ZLbetXOffismin8Gg3E-U8Bzud3Yxs9gT-N-tXicoIKxysvIuc May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:09:31.234891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13903400ae4744c6aab71bda83e84118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13903400ae4744c6aab71bda83e84118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 13903400ae4744c6aab71bda83e84118 May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-VolumesNegativeTest-1657120177 May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 104c29b17a454c95ae38fd37c692e1de May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-VolumesNegativeTest-1657120177-project May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Volume 49e0a622-716d-4171-ad71-b85da6d35b38 could not be found. May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '49e0a622-716d-4171-ad71-b85da6d35b38'} May 10 15:09:31.236235 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49e0a622-716d-4171-ad71-b85da6d35b38 could not be found. (HTTP 404) (Request-ID: req-a3e6a352-4607-4d1a-86bc-c89dec59bb22) May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.237008 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 15:09:31.238172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49e0a622-716d-4171-ad71-b85da6d35b38 could not be found. May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 15:09:31.239365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49e0a622-716d-4171-ad71-b85da6d35b38 could not be found. May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49e0a622-716d-4171-ad71-b85da6d35b38 could not be found. May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-070ca864-64cf-4f89-9ab8-9a479f669f3a tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] Returning 404 to user: Volume 49e0a622-716d-4171-ad71-b85da6d35b38 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-070ca864-64cf-4f89-9ab8-9a479f669f3a tempest-VolumesNegativeTest-1657120177 tempest-VolumesNegativeTest-1657120177-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49e0a622-716d-4171-ad71-b85da6d35b38" status: 404 len: 109 microversion: 2.1 time: 0.036422 May 10 15:09:31.240486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 371/761] 10.222.0.83 () {58 vars in 1244 bytes} [Tue May 10 15:09:31 2022] GET /compute/v2.1/os-volumes/49e0a622-716d-4171-ad71-b85da6d35b38 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:09:31.965652 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:31.966287 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:31.977454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:31.979094 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:31.980016 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:31.980508 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:32.142245 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:32.150495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:32.152091 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:32.153347 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f3a2b033-e071-4a94-af3a-40007f08c052 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.192018 May 10 15:09:32.164720 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 391/762] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:31 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:32.747914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-d427fb96-649f-4f85-bc09-7e2e1d7c6180 req-d2dc02be-d1d3-48be-93bd-be3025fb5ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b73b3a-5044-4050-9df7-63449017d71b", "name": "network-vif-plugged", "status": "completed", "tag": "894eaf97-5fb6-48fd-9978-9efc8dd336f9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:32.770969 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-d427fb96-649f-4f85-bc09-7e2e1d7c6180 req-d2dc02be-d1d3-48be-93bd-be3025fb5ac4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:32.771926 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-d427fb96-649f-4f85-bc09-7e2e1d7c6180 req-d2dc02be-d1d3-48be-93bd-be3025fb5ac4 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:32.796133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-d427fb96-649f-4f85-bc09-7e2e1d7c6180 req-d2dc02be-d1d3-48be-93bd-be3025fb5ac4 service nova] Creating event network-vif-plugged:894eaf97-5fb6-48fd-9978-9efc8dd336f9 for instance b4b73b3a-5044-4050-9df7-63449017d71b on hv-cinder-83962 May 10 15:09:32.807480 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-d427fb96-649f-4f85-bc09-7e2e1d7c6180 req-d2dc02be-d1d3-48be-93bd-be3025fb5ac4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064513 May 10 15:09:32.808602 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 372/763] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:33.171129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:33.171762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:33.179133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:33.179591 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:33.186483 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:33.187113 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:33.361012 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:33.374582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:33.384999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:33.387211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3e50d417-c323-41dd-a8de-c298cf327885 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.219902 May 10 15:09:33.388491 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 392/764] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:33 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:34.412520 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:34.413233 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:34.421392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:34.422026 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:34.423025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:34.423633 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:34.619303 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:34.629326 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:34.631264 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:34.633128 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a1a37c6c-2c18-4a04-984a-683e2e761a0d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.231104 May 10 15:09:34.634902 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 373/765] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:34 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:35.654479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:35.654968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:35.665639 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:35.666516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:35.667691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:35.668658 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:35.827640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:35.838031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:35.839740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:35.840902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0ee7aba9-c261-4c20-8d0b-acb632998acd tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.192517 May 10 15:09:35.851869 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 393/766] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:35 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:36.860369 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:36.861827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:36.869402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:36.870087 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:36.871371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:36.872225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:37.056114 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:37.073809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:37.076392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:37.077938 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-70b39879-978b-450b-ab18-1cfaa259a6fc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.221829 May 10 15:09:37.095889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 374/767] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:36 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:38.113883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:38.114717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:38.127694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:38.128144 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:38.128953 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:38.129390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:38.300465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:38.311466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:38.313717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:38.315321 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-54a49759-92ac-4207-ba8e-ba844e05ed27 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.208188 May 10 15:09:38.316382 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 394/768] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:38 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:39.334317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:39.334963 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:39.341673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:39.342118 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:39.342916 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:39.343354 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:39.523462 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:39.532281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:39.533792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:39.534977 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d6b2560a-3bf8-4375-a6b8-d51a58abdc45 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.204487 May 10 15:09:39.535826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 375/769] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:39 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:40.555157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:40.555754 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:40.561932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:40.562443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:40.563182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:40.563622 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:40.691361 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:40.699585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:40.701108 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:40.702261 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a23f4b04-d0ac-42dd-a607-61dba96de682 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1740 microversion: 2.20 time: 0.150976 May 10 15:09:40.702875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 395/770] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:40 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:41.720631 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:41.721241 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:41.728533 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:41.728982 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:41.729739 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:41.730177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:41.869569 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:41.877714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:41.879244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:41.880402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-530950ab-da94-472b-a02d-2ae5c36b43f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1722 microversion: 2.20 time: 0.163653 May 10 15:09:41.880970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 376/771] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:41 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:42.654791 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-a6667556-3e44-49ee-b171-7e4148398a59 req-40fb641e-8379-412a-b8f7-8959fd5ca2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b73b3a-5044-4050-9df7-63449017d71b", "name": "network-vif-unplugged", "status": "completed", "tag": "894eaf97-5fb6-48fd-9978-9efc8dd336f9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:42.662570 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-a6667556-3e44-49ee-b171-7e4148398a59 req-40fb641e-8379-412a-b8f7-8959fd5ca2c3 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:42.663017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-a6667556-3e44-49ee-b171-7e4148398a59 req-40fb641e-8379-412a-b8f7-8959fd5ca2c3 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:42.674636 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-a6667556-3e44-49ee-b171-7e4148398a59 req-40fb641e-8379-412a-b8f7-8959fd5ca2c3 service nova] Creating event network-vif-unplugged:894eaf97-5fb6-48fd-9978-9efc8dd336f9 for instance b4b73b3a-5044-4050-9df7-63449017d71b on hv-cinder-83962 May 10 15:09:42.679538 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-a6667556-3e44-49ee-b171-7e4148398a59 req-40fb641e-8379-412a-b8f7-8959fd5ca2c3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029100 May 10 15:09:42.680165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 396/772] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:42.898716 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:42.899914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:42.906154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:42.906657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:42.907402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:42.907837 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:43.037281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:43.045264 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:43.046819 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:43.048058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7e3d5a3a-2acf-47b2-974f-0b2effc9efdc tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1722 microversion: 2.20 time: 0.153099 May 10 15:09:43.048825 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 377/773] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:42 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:44.069750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:44.070481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:44.078105 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.078689 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:44.079466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.079991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:44.207742 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:44.215965 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:44.217608 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:44.218980 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8c5673fb-3e27-409d-afe4-02857597f278 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1665 microversion: 2.20 time: 0.153947 May 10 15:09:44.219612 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 397/774] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:44 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:44.237211 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2514d044-834c-425c-9193-4c22231a8a48 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff0686a-373f-47fd-9fe4-e66b52796d86"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:44.238286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2514d044-834c-425c-9193-4c22231a8a48 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:44.245039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2514d044-834c-425c-9193-4c22231a8a48 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.245492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2514d044-834c-425c-9193-4c22231a8a48 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:44.246265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2514d044-834c-425c-9193-4c22231a8a48 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.246741 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2514d044-834c-425c-9193-4c22231a8a48 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:44.520155 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2514d044-834c-425c-9193-4c22231a8a48 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286871 May 10 15:09:44.530777 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 378/775] 10.222.0.83 () {62 vars in 1363 bytes} [Tue May 10 15:09:44 2022] POST /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 15:09:44.643544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c6ff1e1b-9556-4696-9e53-4748846987ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:44.644043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c6ff1e1b-9556-4696-9e53-4748846987ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:44.651071 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ff1e1b-9556-4696-9e53-4748846987ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.651523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ff1e1b-9556-4696-9e53-4748846987ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:44.652299 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ff1e1b-9556-4696-9e53-4748846987ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.652735 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c6ff1e1b-9556-4696-9e53-4748846987ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:44.881168 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c6ff1e1b-9556-4696-9e53-4748846987ba tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-volume_attachments/4ff0686a-373f-47fd-9fe4-e66b52796d86" status: 202 len: 0 microversion: 2.20 time: 0.242016 May 10 15:09:44.882263 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 398/776] 10.222.0.83 () {60 vars in 1456 bytes} [Tue May 10 15:09:44 2022] DELETE /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-volume_attachments/4ff0686a-373f-47fd-9fe4-e66b52796d86 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 15:09:44.936864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-87987d6b-eb76-4245-ac05-7dbed1775c8c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:44.937423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-87987d6b-eb76-4245-ac05-7dbed1775c8c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:44.943408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-87987d6b-eb76-4245-ac05-7dbed1775c8c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.943854 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-87987d6b-eb76-4245-ac05-7dbed1775c8c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:44.944611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-87987d6b-eb76-4245-ac05-7dbed1775c8c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:44.945041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-87987d6b-eb76-4245-ac05-7dbed1775c8c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:45.124974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-87987d6b-eb76-4245-ac05-7dbed1775c8c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "POST /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/action" status: 202 len: 0 microversion: 2.20 time: 0.191978 May 10 15:09:45.125703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 379/777] 10.222.0.83 () {62 vars in 1318 bytes} [Tue May 10 15:09:44 2022] POST /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 15:09:45.133836 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:45.135176 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:45.144601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:45.145306 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:45.146156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:45.146696 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:45.309322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:45.317090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:45.318635 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:45.319893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ad9413f3-fd40-4300-8442-d7b1b03357f9 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1673 microversion: 2.20 time: 0.189952 May 10 15:09:45.320464 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 399/778] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:45 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:09:46.338970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:46.339622 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:46.346111 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:46.346598 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:46.347375 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:46.347816 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:46.481339 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:46.489223 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:46.490779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:46.491927 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3bb6d3fb-dda5-43c7-9910-adef13f0334f tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.157904 May 10 15:09:46.495788 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 380/779] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:46 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:47.512573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:47.513246 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:47.519435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:47.519889 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:47.520666 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:47.521103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:47.664086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:47.672161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:47.673688 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:47.674873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-52be0259-d523-4942-aba9-5f632e57367d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.167002 May 10 15:09:47.675440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 400/780] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:47 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:48.693674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:48.694292 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:48.701866 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:48.702315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:48.703123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:48.703555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:48.852522 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:48.863093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:48.864896 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:48.866242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7cff740a-7288-4b67-abc0-b7e73d676fbf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.177003 May 10 15:09:48.866997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 381/781] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:48 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:49.886138 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:49.887387 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:49.893643 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:49.894089 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:49.895073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:49.895666 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:50.059590 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:50.069345 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:50.071847 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:50.073480 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-17bbd04a-de48-4d84-9350-686f9e469890 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.191834 May 10 15:09:50.074292 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 401/782] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:49 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:51.092601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:51.093242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:51.100095 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:51.100584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:51.101583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:51.102048 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:51.257272 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:51.266531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:51.269095 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:51.271044 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-dda00c66-2e9a-45ca-9f81-b0c667709a83 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.182435 May 10 15:09:51.271690 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 382/783] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:51 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:52.290972 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:52.292091 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:52.298804 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:52.299556 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:52.300560 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:52.301218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:52.521057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:52.533378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:52.535882 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:52.537283 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-963d0258-7374-4a7e-9fd4-295fb03d8ea6 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.250825 May 10 15:09:52.549195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 402/784] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:52 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:53.556490 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:53.557147 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:53.566508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:53.567264 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:53.568368 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:53.568668 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:53.733986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:53.751530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:53.753522 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:53.755264 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b1d994f5-7706-4e50-a00e-f55aeb13f82e tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.203704 May 10 15:09:53.756004 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 383/785] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:53 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:54.773474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:54.774295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:54.780588 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:54.781045 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:54.781831 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:54.782271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:55.009905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:55.019930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:55.023895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:55.023895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-18427598-b1ca-4ce2-98e0-55f0ee20c41c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.253681 May 10 15:09:55.024184 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 403/786] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:54 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:55.127241 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2668bdce-7648-4a98-818d-4a4595f4071f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:55.127827 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2668bdce-7648-4a98-818d-4a4595f4071f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:55.135082 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2668bdce-7648-4a98-818d-4a4595f4071f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:55.135550 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2668bdce-7648-4a98-818d-4a4595f4071f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:55.136349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2668bdce-7648-4a98-818d-4a4595f4071f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:55.136976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2668bdce-7648-4a98-818d-4a4595f4071f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:55.170858 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2668bdce-7648-4a98-818d-4a4595f4071f tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/ips" status: 200 len: 148 microversion: 2.1 time: 0.047481 May 10 15:09:55.172063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 384/787] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:09:55 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:56.041161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:56.042452 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:56.049634 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:56.062660 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:56.064292 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:56.064906 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:56.247908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:56.266017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:56.269836 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:56.271997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-aca49753-289a-46e1-993f-781bd2d4ad7a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.234732 May 10 15:09:56.272782 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 404/788] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:56 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:56.705376 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-52f132cc-f94c-45b1-9149-93bfc14004cd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4f2e43e-33f7-4eec-a06b-5af603154c6c"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:09:56.706554 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-52f132cc-f94c-45b1-9149-93bfc14004cd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:56.713682 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-52f132cc-f94c-45b1-9149-93bfc14004cd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:56.714133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-52f132cc-f94c-45b1-9149-93bfc14004cd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:56.714931 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-52f132cc-f94c-45b1-9149-93bfc14004cd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:56.715374 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-52f132cc-f94c-45b1-9149-93bfc14004cd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:57.028412 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-52f132cc-f94c-45b1-9149-93bfc14004cd tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "POST /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326677 May 10 15:09:57.029313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 385/789] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:09:56 2022] POST /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:09:57.290691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:57.291404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:57.297943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:57.298709 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:57.299499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:57.299943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:57.441653 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:57.452554 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:57.454619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:57.456573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-aa9520eb-0bde-4a33-8e49-a9beb40375aa tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.169669 May 10 15:09:57.486733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 405/790] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:57 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:58.482598 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:58.484990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:58.506171 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:58.506806 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:58.508236 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:58.512880 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:58.693392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:58.702267 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:58.703843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:58.705010 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6f739eb7-8cfa-43aa-8ebc-4674651c7ad5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.231920 May 10 15:09:58.705572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 386/791] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:58 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:09:59.723937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:09:59.724545 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:09:59.731903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:59.732349 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:59.733114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:09:59.733543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:09:59.957808 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:59.968689 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:59.970212 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:09:59.971409 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b6bbe7c2-51b7-4a11-95e4-505f9e853abf tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.251478 May 10 15:09:59.972163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 406/792] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:09:59 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:10:00.991035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:00.991652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:00.999700 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:01.000792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:01.001805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:01.002469 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:01.443674 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-783bb19b-15ba-4b71-b5f3-763942f4b03b req-e013556a-9e62-4b3d-9fe9-dbfb16bb768c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b73b3a-5044-4050-9df7-63449017d71b", "name": "network-vif-plugged", "status": "completed", "tag": "894eaf97-5fb6-48fd-9978-9efc8dd336f9"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:01.463076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-783bb19b-15ba-4b71-b5f3-763942f4b03b req-e013556a-9e62-4b3d-9fe9-dbfb16bb768c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:01.463525 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-783bb19b-15ba-4b71-b5f3-763942f4b03b req-e013556a-9e62-4b3d-9fe9-dbfb16bb768c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:01.485054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-783bb19b-15ba-4b71-b5f3-763942f4b03b req-e013556a-9e62-4b3d-9fe9-dbfb16bb768c service nova] Creating event network-vif-plugged:894eaf97-5fb6-48fd-9978-9efc8dd336f9 for instance b4b73b3a-5044-4050-9df7-63449017d71b on hv-cinder-83962 May 10 15:10:01.501221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-783bb19b-15ba-4b71-b5f3-763942f4b03b req-e013556a-9e62-4b3d-9fe9-dbfb16bb768c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054345 May 10 15:10:01.502180 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 407/793] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:10:01.601577 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:01.614760 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:01.619212 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:01.624231 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e38ae9c2-8f99-4483-ae9a-837f7668c055 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.637187 May 10 15:10:01.627551 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 387/794] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:00 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:10:02.656476 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:02.657908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:02.676778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:02.683218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:02.685442 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:02.687764 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:03.066563 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:03.076148 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:03.086332 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:03.088043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3c0fd64f-72a8-41ed-90a9-68b4af41d741 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.441714 May 10 15:10:03.092315 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 408/795] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:02 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:10:04.110078 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:04.110821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:04.122185 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:04.122702 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:04.123488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:04.124103 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:04.313788 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:04.321907 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:04.323448 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:04.324612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bc09e4fc-263f-4bb7-9dd7-fdfad173d6db tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1731 microversion: 2.20 time: 0.218429 May 10 15:10:04.325168 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 388/796] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:04 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:10:04.807031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:04.808216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:04.815454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:04.815979 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:04.816817 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:04.817313 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:04.948841 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lazy-loading 'services' on Instance uuid 66b3a64c-3f42-4c9e-93af-365cc96e737a {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:10:05.051000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e0d36432-352b-47b6-890d-c4bcc81fa683 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments/b4f2e43e-33f7-4eec-a06b-5af603154c6c" status: 202 len: 0 microversion: 2.1 time: 0.247583 May 10 15:10:05.052337 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 409/797] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:10:04 2022] DELETE /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments/b4f2e43e-33f7-4eec-a06b-5af603154c6c => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:10:05.062685 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-57e26be5-664f-4e9c-a667-8665d5aa439e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:05.064224 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-57e26be5-664f-4e9c-a667-8665d5aa439e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:05.077896 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-57e26be5-664f-4e9c-a667-8665d5aa439e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:05.078758 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-57e26be5-664f-4e9c-a667-8665d5aa439e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:05.083976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-57e26be5-664f-4e9c-a667-8665d5aa439e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:05.084779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-57e26be5-664f-4e9c-a667-8665d5aa439e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:05.163063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-57e26be5-664f-4e9c-a667-8665d5aa439e tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100423 May 10 15:10:05.164759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 389/798] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:10:05 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:10:05.344749 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:05.345444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:05.356360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:05.357017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:05.357995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:05.358453 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:05.523315 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:05.532475 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:05.534005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:05.535207 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-058a9cfd-abb3-47b2-ae9d-cba7af455b34 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1718 microversion: 2.20 time: 0.195250 May 10 15:10:05.536088 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 410/799] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:05 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1718 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:10:06.175920 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-25e84a51-9e96-40f5-83d6-475b5a8e9b5d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:06.177754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-25e84a51-9e96-40f5-83d6-475b5a8e9b5d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:06.188001 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25e84a51-9e96-40f5-83d6-475b5a8e9b5d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:06.188728 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25e84a51-9e96-40f5-83d6-475b5a8e9b5d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:06.189657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25e84a51-9e96-40f5-83d6-475b5a8e9b5d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:06.190296 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-25e84a51-9e96-40f5-83d6-475b5a8e9b5d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:06.233409 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-25e84a51-9e96-40f5-83d6-475b5a8e9b5d tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061341 May 10 15:10:06.239674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 390/800] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:10:06 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:10:06.355254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:06.355813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:06.362295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:06.362860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:06.363654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:06.364098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:06.407103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:10:06.567419 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c8f9fbc4-d7d2-4e47-bed0-715a02e94b51 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 204 len: 0 microversion: 2.1 time: 0.215658 May 10 15:10:06.573027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 411/801] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:10:06 2022] DELETE /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:10:06.577948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:06.578592 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:06.586490 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:06.586941 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:06.588793 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:06.589467 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:06.799416 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:06.812214 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0fb0d136-a045-424b-9ff3-e9ec7d142676 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1679 microversion: 2.1 time: 0.236522 May 10 15:10:06.822166 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 391/802] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:06 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:07.829611 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:07.830472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:07.838823 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:07.839532 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:07.840675 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:07.841388 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:08.013434 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:08.022111 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-10c655de-60ac-4188-a81d-f52a6ba89fb8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1679 microversion: 2.1 time: 0.196749 May 10 15:10:08.028126 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 412/803] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:07 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:09.044748 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:09.045500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:09.052063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:09.052762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:09.053546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:09.054159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:09.128439 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06701ca6a5e0427c9d5b540133c522a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8961e0a1d6d443a0847533b83aa1ea8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:09.138973 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-95722af9-64fc-4641-907d-e763939946c8 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 200 len: 1612 microversion: 2.1 time: 0.098102 May 10 15:10:09.140145 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 392/804] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:09 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 1612 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:09.261376 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-01b65f67-8cc9-4e9f-bea5-b071fe62eb82 req-a1c7f06d-db4c-415e-94b1-aa5c2ba396d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b3a64c-3f42-4c9e-93af-365cc96e737a", "name": "network-vif-deleted", "tag": "8249c515-6b47-4c2d-96f0-3890fe222b3f"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:09.298355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-01b65f67-8cc9-4e9f-bea5-b071fe62eb82 req-a1c7f06d-db4c-415e-94b1-aa5c2ba396d7 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:09.301177 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-01b65f67-8cc9-4e9f-bea5-b071fe62eb82 req-a1c7f06d-db4c-415e-94b1-aa5c2ba396d7 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:09.314933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-01b65f67-8cc9-4e9f-bea5-b071fe62eb82 req-a1c7f06d-db4c-415e-94b1-aa5c2ba396d7 service nova] Creating event network-vif-deleted:8249c515-6b47-4c2d-96f0-3890fe222b3f for instance 66b3a64c-3f42-4c9e-93af-365cc96e737a on hv-cinder-83962 May 10 15:10:09.320856 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-01b65f67-8cc9-4e9f-bea5-b071fe62eb82 req-a1c7f06d-db4c-415e-94b1-aa5c2ba396d7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067192 May 10 15:10:09.321495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 413/805] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:10.155227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:10.155837 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:10.168755 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:10.169514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:10.170296 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:10.170756 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:10.191893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a HTTP/1.1 May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:10.193709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:10.195256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '66b3a64c-3f42-4c9e-93af-365cc96e737a'} May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:10.196025 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:10.198032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:10.200176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:10.200176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2f37b4eb-7dfc-46c3-a70d-851dc4170031 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 404 len: 111 microversion: 2.1 time: 0.044075 May 10 15:10:10.200176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 393/806] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:10 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:10:10.204780 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c8f2422e-b19e-4cd9-9a8f-dc0267049106 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '.version_select at 0x7f7de0d00dc0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:10.238461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c8f2422e-b19e-4cd9-9a8f-dc0267049106 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363901871" status: 202 len: 0 microversion: 2.1 time: 0.035476 May 10 15:10:10.239665 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 414/807] 10.222.0.83 () {58 vars in 1220 bytes} [Tue May 10 15:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363901871 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:10:12.108980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:12.109499 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:12.116170 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:12.116942 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:12.117921 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:12.118354 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:12.135205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a HTTP/1.1 May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:12.137286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.138952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '66b3a64c-3f42-4c9e-93af-365cc96e737a'} May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:12.142802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.144034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:12.145315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:12.145315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2ba47fc6-c4b5-42fc-95d2-e58f79d424e9 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 404 len: 111 microversion: 2.1 time: 0.033695 May 10 15:10:12.145315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 394/808] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:10:12 2022] DELETE /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:10:12.149183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:12.150011 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 66b3a64c-3f42-4c9e-93af-365cc96e737a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:12.157080 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:12.157842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:12.158734 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:12.159174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:12.173162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a HTTP/1.1 May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:10:12.174797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.176233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '66b3a64c-3f42-4c9e-93af-365cc96e737a'} May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:12.177052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. May 10 15:10:12.178330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:12.181519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 66b3a64c-3f42-4c9e-93af-365cc96e737a could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:12.181519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3fa18826-7e18-4f7f-876c-23bf31db51da tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a" status: 404 len: 111 microversion: 2.1 time: 0.034067 May 10 15:10:12.181519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 415/809] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:12 2022] GET /compute/v2.1/servers/66b3a64c-3f42-4c9e-93af-365cc96e737a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:10:13.325119 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:13.325627 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:13.332178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.332675 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.333799 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.334609 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.349139 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b HTTP/1.1 May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:13.350814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.352714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'b423901c-6ff6-4d8e-88fd-fc1fd3f4309b'} May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:13.353629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.355502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.358283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:13.358283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2a41cf81-d67d-40a3-bbec-04a334b2eeb7 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 404 len: 111 microversion: 2.1 time: 0.032049 May 10 15:10:13.358283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 395/810] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:10:13 2022] DELETE /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:10:13.362261 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:13.362923 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: b423901c-6ff6-4d8e-88fd-fc1fd3f4309b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:13.369985 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.370545 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.371394 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.371905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.387770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b HTTP/1.1 May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:10:13.389751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.391340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'b423901c-6ff6-4d8e-88fd-fc1fd3f4309b'} May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:13.392200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. May 10 15:10:13.393604 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.395486 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance b423901c-6ff6-4d8e-88fd-fc1fd3f4309b could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:13.395486 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ea04b98b-5590-45d4-a18c-3b8252577955 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b" status: 404 len: 111 microversion: 2.1 time: 0.034234 May 10 15:10:13.397023 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 416/811] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:13 2022] GET /compute/v2.1/servers/b423901c-6ff6-4d8e-88fd-fc1fd3f4309b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 15:10:13.403104 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:13.403613 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:13.409952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.410417 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.411224 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.411667 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.426804 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 HTTP/1.1 May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:13.428703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.430161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '527d8853-d7e4-4507-b15b-6b9c0616ca94'} May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:13.430968 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.432420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:13.434279 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:13.434279 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-de640606-e49b-4d7b-8e1f-789fe7146a64 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 404 len: 111 microversion: 2.1 time: 0.030998 May 10 15:10:13.434279 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 396/812] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:10:13 2022] DELETE /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 15:10:13.438785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:13.439404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 527d8853-d7e4-4507-b15b-6b9c0616ca94] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:13.450504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.450989 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.451852 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:13.452295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:13.467538 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 HTTP/1.1 May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:10:13.469194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.470746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '527d8853-d7e4-4507-b15b-6b9c0616ca94'} May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:13.471669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. May 10 15:10:13.473162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:13.475230 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 527d8853-d7e4-4507-b15b-6b9c0616ca94 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:13.475230 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5926813b-8536-4f79-8399-eaa1907ca12c tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94" status: 404 len: 111 microversion: 2.1 time: 0.035664 May 10 15:10:13.475230 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 417/813] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:13 2022] GET /compute/v2.1/servers/527d8853-d7e4-4507-b15b-6b9c0616ca94 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:10:13.557496 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d3c965f1-d96d-4906-a662-1345fadea8ad tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Action: 'create', calling method: .version_select at 0x7f7de5c02670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1359460779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPeMaM9e+d2sRUMb3TcVWth6yAgNj4Kvbp94XLZW2FbhY0zqAC4COSIUM2FWq3WlUpDFw748q6UMqxvxewEj9otgyWc96zeVCDcvZBWUkc2Se4oIHJc8Qbp9+W9Sfly/Q=="}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:13.574679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-d3c965f1-d96d-4906-a662-1345fadea8ad tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Getting quotas for project 69cc7901bd8e4ff68b7e943121e69580. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:10:13.578663 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-d3c965f1-d96d-4906-a662-1345fadea8ad tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Getting quotas for user 4db1da4361c444da87400db06bbae3e4 and project 69cc7901bd8e4ff68b7e943121e69580. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:10:13.602351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d3c965f1-d96d-4906-a662-1345fadea8ad tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048730 May 10 15:10:13.603029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 397/814] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:10:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:13.660250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-515376139", "imageRef": "b81b8ebd-c868-429d-8b8b-0a438f7a5c99", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1359460779", "networks": [{"uuid": "a56999be-3a54-42c1-b29a-0ce876aff707"}]}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:13.709322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] validate_networks() for [('a56999be-3a54-42c1-b29a-0ce876aff707', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:10:14.062850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:10:14.063280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:10:14.063763 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:10:14.064172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:10:14.064585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:10:14.073773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:14.074143 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:14.074992 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:14.075434 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:14.092881 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Getting quotas for project 69cc7901bd8e4ff68b7e943121e69580. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:10:14.096770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Getting quotas for user 4db1da4361c444da87400db06bbae3e4 and project 69cc7901bd8e4ff68b7e943121e69580. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:10:14.107848 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:10:14.110047 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b81b8ebd-c868-429d-8b8b-0a438f7a5c99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:10:14.154674 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c59d4f2b-be3a-439d-92d3-f96d2968144d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498307 May 10 15:10:14.155316 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 418/815] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:10:14.165337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2ee49922-6d09-4513-ad65-dc5ecd83ec88 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:14.165971 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2ee49922-6d09-4513-ad65-dc5ecd83ec88 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:14.218362 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2ee49922-6d09-4513-ad65-dc5ecd83ec88 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:14.228313 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2ee49922-6d09-4513-ad65-dc5ecd83ec88 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1258 microversion: 2.1 time: 0.066808 May 10 15:10:14.228893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 398/816] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:14 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:10:14.611029 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:14.611651 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:14.619173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:14.619617 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:14.620375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:14.620979 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:14.635089 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: DELETE /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c HTTP/1.1 May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:10:14.636637 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.638174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '11828dfd-b035-4c1b-a5b7-61553717870c'} May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:14.639182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.640713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:14.643280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:14.643280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-10c71f96-08a0-4eee-87db-f8784c640377 tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "DELETE /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 404 len: 111 microversion: 2.1 time: 0.030979 May 10 15:10:14.643280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 419/817] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:10:14 2022] DELETE /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:10:14.646605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:14.647219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] [instance: 11828dfd-b035-4c1b-a5b7-61553717870c] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:14.654197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:14.654660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:14.655426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:14.655853 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:14.669426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] HTTP exception thrown: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Request method failure captured: May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c HTTP/1.1 May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien6w5AmiaklqjLKIjZRLDRfmiyoAj9_cxPlR8U4ZF-oOTnrci55NUCJcFs1Z3M6aKEa4d9nlBPVcItDNdoXb-7HGD3m8OzRwb7jLVyqsQ0tvkeRQqB9wqhRNw7ICbXyGeiP8trcDAKmQUlf0a1tLmbeYiBjXKCf40rGKnol-Dcdv29g May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:14.670972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8961e0a1d6d443a0847533b83aa1ea8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 8961e0a1d6d443a0847533b83aa1ea8b May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73179358 May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 06701ca6a5e0427c9d5b540133c522a0 May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeNegativeTest-73179358-project May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.672587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '11828dfd-b035-4c1b-a5b7-61553717870c'} May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:14.673693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. May 10 15:10:14.675126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:14.677413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] Returning 404 to user: Instance 11828dfd-b035-4c1b-a5b7-61553717870c could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:14.677413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-88a9ca4b-6a64-4297-958e-f77f682d8bfa tempest-AttachVolumeNegativeTest-73179358 tempest-AttachVolumeNegativeTest-73179358-project] 10.222.0.83 "GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c" status: 404 len: 111 microversion: 2.1 time: 0.029579 May 10 15:10:14.677413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 399/818] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:14 2022] GET /compute/v2.1/servers/11828dfd-b035-4c1b-a5b7-61553717870c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:10:15.245192 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:15.245813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:15.251970 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:15.252425 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:15.253196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:15.253634 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:15.356389 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:15.364173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-964542c7-b3a4-4886-8551-ca17a100b938 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1316 microversion: 2.1 time: 0.122913 May 10 15:10:15.364750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 420/819] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:15 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1316 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:16.381817 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:16.383300 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:16.394061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:16.394829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:16.396056 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:16.396700 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:16.580819 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:16.595739 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cae5cdfb-84d6-4a61-8866-dd401c95b4a3 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.216797 May 10 15:10:16.601039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 400/820] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:16 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:17.615031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:17.617164 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:17.626712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:17.627413 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:17.628772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:17.629415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:17.932294 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:17.940543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-283fb9ac-6835-4724-bdcc-08c20a9e7860 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.331265 May 10 15:10:17.941204 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 421/821] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:17 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:18.957404 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:18.958029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:18.971469 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:18.971948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:18.972654 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:18.973336 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:19.281035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:19.293256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-297877eb-4cd3-4d44-92f4-d10cfbed93f8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.339997 May 10 15:10:19.304614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 401/822] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:18 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:20.309916 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:20.310578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:20.317026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:20.317479 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:20.318289 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:20.318794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:20.488952 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:20.499078 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-04ad48cd-cc01-4511-b7b8-c01ca1c53a06 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.193090 May 10 15:10:20.509408 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 422/823] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:20 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:21.517433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:21.518649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:21.526810 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:21.527528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:21.528565 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:21.529176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:21.698474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:21.705876 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f2943036-3731-4f9c-a4d1-1f8f502d9325 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.192916 May 10 15:10:21.707064 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 402/824] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:21 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:22.727491 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:22.729522 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:22.740082 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:22.741169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:22.743559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:22.744510 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:22.904053 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:22.915023 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e221f2cd-df09-4ddb-b578-46fb7c2bbfc5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.195100 May 10 15:10:22.924488 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 423/825] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:22 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:23.932600 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:23.934012 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:23.940647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:23.941402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:23.942411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:23.943069 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:24.140500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:24.152798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-81202128-d48c-425a-970d-dc4d689a8ce9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.224375 May 10 15:10:24.154434 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 403/826] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:23 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:25.169997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:25.170601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:25.176840 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:25.177287 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:25.178054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:25.178519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:25.434179 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:25.441727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4424d3cd-f030-490b-87fa-530238d5fda1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.275690 May 10 15:10:25.442628 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 424/827] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:25 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:25.831364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-8a097b69-f017-47a2-b0d3-3c9ba935642d req-f3ce71d7-2703-4cb1-bc10-4281fad97ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab178055-4b1f-4396-a555-7f196d8a076d", "tag": "03b834c1-546f-44db-a170-4f24b1f202fb"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:25.850009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8a097b69-f017-47a2-b0d3-3c9ba935642d req-f3ce71d7-2703-4cb1-bc10-4281fad97ec8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:25.850594 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8a097b69-f017-47a2-b0d3-3c9ba935642d req-f3ce71d7-2703-4cb1-bc10-4281fad97ec8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:25.867481 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-8a097b69-f017-47a2-b0d3-3c9ba935642d req-f3ce71d7-2703-4cb1-bc10-4281fad97ec8 service nova] Creating event network-changed:03b834c1-546f-44db-a170-4f24b1f202fb for instance ab178055-4b1f-4396-a555-7f196d8a076d on hv-cinder-83962 May 10 15:10:25.873417 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-8a097b69-f017-47a2-b0d3-3c9ba935642d req-f3ce71d7-2703-4cb1-bc10-4281fad97ec8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056221 May 10 15:10:25.873928 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 404/828] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:26.459341 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:26.460003 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:26.466250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:26.466737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:26.467514 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:26.467954 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:26.599104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:26.607481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ce834d45-c2ed-4823-a9c5-85f2626e4316 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.151986 May 10 15:10:26.608063 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 425/829] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:26 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:27.625684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:27.626528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:27.633613 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:27.634058 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:27.634935 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:27.635372 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:27.777965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:27.785366 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9793b5b7-f586-4838-9422-546ee6704496 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.164096 May 10 15:10:27.785947 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 405/830] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:27 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:28.802438 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:28.803139 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:28.809997 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:28.810474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:28.811248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:28.811687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:28.945006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:28.952196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e6386d3b-4447-45b7-b0e9-ed396fff7735 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.153697 May 10 15:10:28.952780 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 426/831] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:28 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:29.968929 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:29.969538 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:29.976454 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:29.976905 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:29.977672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:29.978105 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:30.103194 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:30.110434 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a42b95ff-4f7f-4a6c-b9b9-2dc17242bb97 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.145388 May 10 15:10:30.111005 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 406/832] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:29 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:31.127033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:31.127643 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:31.133903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:31.134347 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:31.135156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:31.135573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:31.262244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:31.269365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-dfda7819-65f0-4b3a-97f1-377c19c76815 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.146228 May 10 15:10:31.269927 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 427/833] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:31 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:32.286539 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:32.287614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:32.294244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:32.294728 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:32.295564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:32.296003 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:32.425933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:32.436335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ce323994-063a-4747-a7a7-56085ff48b54 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.153744 May 10 15:10:32.436918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 407/834] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:32 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:32.971693 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-33936034-ed6d-4435-a797-b9500236141d req-00b47e9b-f9e4-45f5-8a87-89c3982cdcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab178055-4b1f-4396-a555-7f196d8a076d", "name": "network-vif-plugged", "status": "completed", "tag": "03b834c1-546f-44db-a170-4f24b1f202fb"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:32.989110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-33936034-ed6d-4435-a797-b9500236141d req-00b47e9b-f9e4-45f5-8a87-89c3982cdcbf service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:32.992868 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-33936034-ed6d-4435-a797-b9500236141d req-00b47e9b-f9e4-45f5-8a87-89c3982cdcbf service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:33.005534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-33936034-ed6d-4435-a797-b9500236141d req-00b47e9b-f9e4-45f5-8a87-89c3982cdcbf service nova] Creating event network-vif-plugged:03b834c1-546f-44db-a170-4f24b1f202fb for instance ab178055-4b1f-4396-a555-7f196d8a076d on hv-cinder-83962 May 10 15:10:33.011726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-33936034-ed6d-4435-a797-b9500236141d req-00b47e9b-f9e4-45f5-8a87-89c3982cdcbf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049532 May 10 15:10:33.012633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 428/835] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:33.452884 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:33.453994 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:33.460691 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:33.461137 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:33.461907 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:33.462339 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:33.602694 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:33.610574 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-93601b8e-7b13-42e5-8ed4-aa9994b7266a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.161339 May 10 15:10:33.611229 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 408/836] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:33 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:34.628196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:34.628890 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:34.635555 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:34.635996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:34.636747 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:34.637178 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:34.769562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:34.777586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ae5df69d-d8cb-4bba-b176-9ca5da920f8f tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1358 microversion: 2.1 time: 0.154026 May 10 15:10:34.778982 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 429/837] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:34 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:35.051685 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-770002647", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "networks": [{"uuid": "13b607e0-34f7-439f-ac23-0cdae73d5c42"}]}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:35.101722 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] validate_networks() for [('13b607e0-34f7-439f-ac23-0cdae73d5c42', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:10:35.430594 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:10:35.431018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:10:35.431492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:10:35.431927 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:10:35.432339 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:10:35.440805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:35.441252 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:35.442056 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:35.442530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:35.458294 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Getting quotas for project 870b2a5de87144f58bdd6aebe78a3e47. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:10:35.462171 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Getting quotas for user d4fb5382ce0d4e3694f4c434afc39d94 and project 870b2a5de87144f58bdd6aebe78a3e47. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:10:35.472656 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:10:35.474834 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:10:35.528557 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6436bae4-55bb-478f-baad-54dd31ddf1b9 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480628 May 10 15:10:35.529213 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 409/838] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:10:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:10:35.539587 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-be90d757-c01f-43cb-941a-cfc1590f6b85 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:35.540307 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-be90d757-c01f-43cb-941a-cfc1590f6b85 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:35.591459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-be90d757-c01f-43cb-941a-cfc1590f6b85 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:35.598020 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-be90d757-c01f-43cb-941a-cfc1590f6b85 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1218 microversion: 2.1 time: 0.062824 May 10 15:10:35.598859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 430/839] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:35 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:35.796492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:35.797135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:35.803319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:35.803772 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:35.804550 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:35.804990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:35.939018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:35.947202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e6db6ab7-3544-43c7-b46d-c41533076aaa tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1547 microversion: 2.1 time: 0.154878 May 10 15:10:35.947814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 410/840] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:35 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:35.966337 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:35.966975 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:35.974285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:35.974909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:35.976233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:35.976721 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:36.111740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:36.119444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-be5c8b0c-5d09-4968-9cb5-6d95ff767bdf tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1547 microversion: 2.1 time: 0.157735 May 10 15:10:36.120021 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 431/841] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:35 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:36.136007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:36.139486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:36.140255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Searching by: {'deleted': False, 'project_id': '69cc7901bd8e4ff68b7e943121e69580'} {{(pid=117168) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 15:10:36.147261 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:36.148268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:36.149074 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:36.149514 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:36.239665 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.multi_cell_list [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 15:10:36.331141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2d8d7f25-a1be-43ff-91cd-a1cc2b3f438e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199574 May 10 15:10:36.331733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 411/842] 10.222.0.83 () {58 vars in 1124 bytes} [Tue May 10 15:10:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:36.342629 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:36.343239 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:36.348985 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:36.349430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:36.350181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:36.350642 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:36.483709 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:36.493797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7d5c5df1-59cd-495a-af41-6810c6662e03 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1547 microversion: 2.1 time: 0.155060 May 10 15:10:36.494680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 432/843] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:36 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:36.618958 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:36.620007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:36.627007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:36.627567 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:36.628615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:36.629066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:36.700084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:36.707833 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e0f2be14-f936-4ea6-8f84-804a5ef53068 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1276 microversion: 2.1 time: 0.095075 May 10 15:10:36.708422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 412/844] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:36 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:37.724581 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:37.725200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:37.731909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:37.732367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:37.733147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:37.733589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:37.765224 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-f4c61f19-d148-4a58-a407-5560b6225fbd req-9749f350-e05a-4dac-b9f6-a2d91fce2897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541fd5f4-f3ef-4a42-b50e-a625f2e17734", "tag": "e8eb5d12-4d65-4ec1-9bb7-842395fec078"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:37.776715 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-f4c61f19-d148-4a58-a407-5560b6225fbd req-9749f350-e05a-4dac-b9f6-a2d91fce2897 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:37.777248 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-f4c61f19-d148-4a58-a407-5560b6225fbd req-9749f350-e05a-4dac-b9f6-a2d91fce2897 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:37.788335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-f4c61f19-d148-4a58-a407-5560b6225fbd req-9749f350-e05a-4dac-b9f6-a2d91fce2897 service nova] Creating event network-changed:e8eb5d12-4d65-4ec1-9bb7-842395fec078 for instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 on hv-cinder-83962 May 10 15:10:37.793183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-f4c61f19-d148-4a58-a407-5560b6225fbd req-9749f350-e05a-4dac-b9f6-a2d91fce2897 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034968 May 10 15:10:37.794059 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 413/845] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:37.976619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:37.986363 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-096f1321-7000-415f-9f70-0b5c110717e3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1318 microversion: 2.1 time: 0.265595 May 10 15:10:37.987131 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 433/846] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:37 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:38.047989 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f9c5b1a1-f5b8-4ecf-8cdd-3e9cba5e085d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7daab3e-9a28-404a-9fef-2b3ed8090b70"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:38.049134 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f9c5b1a1-f5b8-4ecf-8cdd-3e9cba5e085d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:38.055578 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9c5b1a1-f5b8-4ecf-8cdd-3e9cba5e085d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:38.056024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9c5b1a1-f5b8-4ecf-8cdd-3e9cba5e085d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:38.056785 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9c5b1a1-f5b8-4ecf-8cdd-3e9cba5e085d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:38.057219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f9c5b1a1-f5b8-4ecf-8cdd-3e9cba5e085d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:38.281688 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f9c5b1a1-f5b8-4ecf-8cdd-3e9cba5e085d tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.237817 May 10 15:10:38.282295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 414/847] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:10:38 2022] POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments => generated 194 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:10:38.616718 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0039998c-2fba-45b6-898e-7dc2935f1d6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:38.617676 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0039998c-2fba-45b6-898e-7dc2935f1d6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:38.623813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0039998c-2fba-45b6-898e-7dc2935f1d6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:38.624263 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0039998c-2fba-45b6-898e-7dc2935f1d6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:38.625024 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0039998c-2fba-45b6-898e-7dc2935f1d6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:38.625459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0039998c-2fba-45b6-898e-7dc2935f1d6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:38.653619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0039998c-2fba-45b6-898e-7dc2935f1d6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041395 May 10 15:10:38.654183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 434/848] 10.222.0.83 () {60 vars in 1342 bytes} [Tue May 10 15:10:38 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:38.709580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:38.710684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:38.717082 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:38.717526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:38.718283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:38.718743 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:38.745959 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:10:38.983691 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-808a4f04-656d-4c58-8418-c4a422293f6a tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 204 len: 0 microversion: 2.20 time: 0.278100 May 10 15:10:38.984598 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 415/849] 10.222.0.83 () {60 vars in 1279 bytes} [Tue May 10 15:10:38 2022] DELETE /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 15:10:38.992390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:38.992999 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:38.999522 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:38.999970 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:39.000735 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:39.001178 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:39.004378 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:39.005070 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:39.011308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:39.011759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:39.012527 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:39.012965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:39.152088 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:39.159299 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-96c172b4-da76-43db-865c-ce8adab6b033 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1318 microversion: 2.1 time: 0.159042 May 10 15:10:39.159862 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 416/850] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:38 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:10:39.172804 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:39.180589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:39.182081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:39.183281 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2625651d-4ffb-42de-b3e5-828cccf57e4d tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.194721 May 10 15:10:39.183850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 435/851] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:38 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 15:10:40.176098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:40.176649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:40.182976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:40.183430 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:40.184225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:40.184682 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:40.202748 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:40.203353 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:40.209499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:40.210480 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:40.211237 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:40.211694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:40.316205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:40.324206 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f083dbf3-bc93-4d5d-9fcc-f93f2e12b12d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1318 microversion: 2.1 time: 0.152035 May 10 15:10:40.324790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 417/852] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:40 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:40.407827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:40.417430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:40.418949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:40.421106 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2327b4a7-eb05-4879-8b4f-cc04671efb39 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1724 microversion: 2.20 time: 0.222138 May 10 15:10:40.421668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 436/853] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:40 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:10:41.340649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:41.341256 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:41.347811 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:41.348300 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:41.349097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:41.349825 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:41.439278 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:41.439896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:41.447077 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:41.448348 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:41.449322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:41.449925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:41.499677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:41.507999 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-18e987b7-7999-45fe-ba0f-2312b7200714 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1318 microversion: 2.1 time: 0.171088 May 10 15:10:41.508725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 418/854] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:41 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:41.649978 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:41.657860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:41.659439 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa56c83ab8494901b85d00d4f592e5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c6a716650343c18e62bbe7235e48c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:41.660791 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c88602a7-a16c-41cc-aeb6-aa113180a796 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 200 len: 1657 microversion: 2.20 time: 0.225337 May 10 15:10:41.661549 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 437/855] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:41 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 1657 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 15:10:41.834429 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-905756c2-0429-4cb9-9054-0cd1ea50b6a0 req-edb92047-6c55-4c24-aaa8-dcbd850e859d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b73b3a-5044-4050-9df7-63449017d71b", "name": "network-vif-deleted", "tag": "894eaf97-5fb6-48fd-9978-9efc8dd336f9"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:41.844100 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-905756c2-0429-4cb9-9054-0cd1ea50b6a0 req-edb92047-6c55-4c24-aaa8-dcbd850e859d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:41.845302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-905756c2-0429-4cb9-9054-0cd1ea50b6a0 req-edb92047-6c55-4c24-aaa8-dcbd850e859d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:41.858081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-905756c2-0429-4cb9-9054-0cd1ea50b6a0 req-edb92047-6c55-4c24-aaa8-dcbd850e859d service nova] Creating event network-vif-deleted:894eaf97-5fb6-48fd-9978-9efc8dd336f9 for instance b4b73b3a-5044-4050-9df7-63449017d71b on hv-cinder-83962 May 10 15:10:41.864440 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-905756c2-0429-4cb9-9054-0cd1ea50b6a0 req-edb92047-6c55-4c24-aaa8-dcbd850e859d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033986 May 10 15:10:41.865630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 419/856] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:42.524664 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:42.525456 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:42.531994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:42.532600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:42.533474 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:42.534014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:42.668311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:42.675773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6377ec43-3aaa-4b74-b23e-02dcd775e7e7 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1318 microversion: 2.1 time: 0.154910 May 10 15:10:42.676358 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 438/857] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:42 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:42.680826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:42.681526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:42.688102 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:42.688552 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:42.689318 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:42.689752 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:42.703652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] HTTP exception thrown: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Request method failure captured: May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b HTTP/1.1 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien630sv3SSiXrtu4TTF5j_1LoQ6EyyFcDcAyD9ZAf15JsCiQDGnX8OafZXs1bNcXMe9Ze5ezrn8esDnXBhCL46hhlTXYbxVllVRUwiXNmsBW80CA7FijC-LlzVYmrFaxI213asZW7Lll8d_hKDJsxrVe01csrkx7wIrpfaDASSHtVj8 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Openstack-Nova-Api-Version: 2.20 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:42.705312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: aa56c83ab8494901b85d00d4f592e5ce May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:42.707024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'b4b73b3a-5044-4050-9df7-63449017d71b'} May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:42.708099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:42.709618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:42.711030 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Returning 404 to user: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:42.711030 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cd918059-9eb1-4fa5-b50d-4644e8aade3c tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 404 len: 111 microversion: 2.20 time: 0.030649 May 10 15:10:42.711195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 420/858] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:42 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 15:10:42.716248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a83ce325-9039-44eb-80ab-88033f372374 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '.version_select at 0x7f7de5d31160>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:42.735443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a83ce325-9039-44eb-80ab-88033f372374 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005969375" status: 204 len: 0 microversion: 2.20 time: 0.023054 May 10 15:10:42.736142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 439/859] 10.222.0.83 () {60 vars in 1261 bytes} [Tue May 10 15:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005969375 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 15:10:43.043558 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-5eb4ec55-7294-475f-9cf8-affabe02bb35 req-0175abf1-258b-421b-91f1-3c8a40a23375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541fd5f4-f3ef-4a42-b50e-a625f2e17734", "name": "network-vif-plugged", "status": "completed", "tag": "e8eb5d12-4d65-4ec1-9bb7-842395fec078"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:43.051795 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-5eb4ec55-7294-475f-9cf8-affabe02bb35 req-0175abf1-258b-421b-91f1-3c8a40a23375 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:43.052346 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-5eb4ec55-7294-475f-9cf8-affabe02bb35 req-0175abf1-258b-421b-91f1-3c8a40a23375 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:43.064335 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-5eb4ec55-7294-475f-9cf8-affabe02bb35 req-0175abf1-258b-421b-91f1-3c8a40a23375 service nova] Creating event network-vif-plugged:e8eb5d12-4d65-4ec1-9bb7-842395fec078 for instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 on hv-cinder-83962 May 10 15:10:43.069325 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-5eb4ec55-7294-475f-9cf8-affabe02bb35 req-0175abf1-258b-421b-91f1-3c8a40a23375 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029529 May 10 15:10:43.070343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 421/860] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:43.694417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:43.695042 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:43.701991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:43.702477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:43.703238 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:43.703763 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:43.836080 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:43.843363 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-fe5bc4f1-6f5c-482a-8dea-eaf1ce2fee12 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1318 microversion: 2.1 time: 0.154207 May 10 15:10:43.843923 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 440/861] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:43 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:44.547626 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:44.548207 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:44.554883 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:44.555487 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:44.556254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:44.556684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:44.569375 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] HTTP exception thrown: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Request method failure captured: May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b HTTP/1.1 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien630sv3SSiXrtu4TTF5j_1LoQ6EyyFcDcAyD9ZAf15JsCiQDGnX8OafZXs1bNcXMe9Ze5ezrn8esDnXBhCL46hhlTXYbxVllVRUwiXNmsBW80CA7FijC-LlzVYmrFaxI213asZW7Lll8d_hKDJsxrVe01csrkx7wIrpfaDASSHtVj8 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Openstack-Nova-Api-Version: 2.20 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:44.571018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: aa56c83ab8494901b85d00d4f592e5ce May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.572684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'b4b73b3a-5044-4050-9df7-63449017d71b'} May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:44.573492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.574750 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:44.575988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Returning 404 to user: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:44.575988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b6ee245a-4b0c-4d79-ac8a-12e810c39210 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 404 len: 111 microversion: 2.20 time: 0.029474 May 10 15:10:44.575988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 422/862] 10.222.0.83 () {60 vars in 1279 bytes} [Tue May 10 15:10:44 2022] DELETE /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 15:10:44.580717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:44.581328 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: b4b73b3a-5044-4050-9df7-63449017d71b] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:44.587879 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:44.588331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:44.589098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:44.589535 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:44.603233 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] HTTP exception thrown: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Request method failure captured: May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b HTTP/1.1 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien630sv3SSiXrtu4TTF5j_1LoQ6EyyFcDcAyD9ZAf15JsCiQDGnX8OafZXs1bNcXMe9Ze5ezrn8esDnXBhCL46hhlTXYbxVllVRUwiXNmsBW80CA7FijC-LlzVYmrFaxI213asZW7Lll8d_hKDJsxrVe01csrkx7wIrpfaDASSHtVj8 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Openstack-Nova-Api-Version: 2.20 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:10:44.604859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: aa56c83ab8494901b85d00d4f592e5ce May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.606650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'b4b73b3a-5044-4050-9df7-63449017d71b'} May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:44.607539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. May 10 15:10:44.608785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:44.609875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Returning 404 to user: Instance b4b73b3a-5044-4050-9df7-63449017d71b could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:44.609875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7bbeafc2-fb00-4cb9-bf34-14f57952a7e5 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b" status: 404 len: 111 microversion: 2.20 time: 0.030139 May 10 15:10:44.609875 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 441/863] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:44 2022] GET /compute/v2.1/servers/b4b73b3a-5044-4050-9df7-63449017d71b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 15:10:44.859401 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:44.860031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:44.865807 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:44.866291 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:44.867110 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:44.867542 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:44.997274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:45.004533 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a76121a6-cd9c-41fb-ad11-35f5a8ca31a3 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1506 microversion: 2.1 time: 0.149055 May 10 15:10:45.005093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 423/864] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:44 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:45.753175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:45.753691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:45.760261 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:45.760714 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:45.761514 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:45.761955 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:45.775044 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] HTTP exception thrown: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Request method failure captured: May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: DELETE /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a HTTP/1.1 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABien630sv3SSiXrtu4TTF5j_1LoQ6EyyFcDcAyD9ZAf15JsCiQDGnX8OafZXs1bNcXMe9Ze5ezrn8esDnXBhCL46hhlTXYbxVllVRUwiXNmsBW80CA7FijC-LlzVYmrFaxI213asZW7Lll8d_hKDJsxrVe01csrkx7wIrpfaDASSHtVj8 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Openstack-Nova-Api-Version: 2.20 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:10:45.776577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: aa56c83ab8494901b85d00d4f592e5ce May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.778206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'a4aac7eb-fbec-4d86-82c9-1237542ad61a'} May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:45.779165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.780610 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:10:45.782094 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Returning 404 to user: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:45.782094 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-29474f98-1930-4ccd-a7c0-e69690b2fc05 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 404 len: 111 microversion: 2.20 time: 0.028709 May 10 15:10:45.782094 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 442/865] 10.222.0.83 () {60 vars in 1279 bytes} [Tue May 10 15:10:45 2022] DELETE /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 15:10:45.786495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:45.787184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] [instance: a4aac7eb-fbec-4d86-82c9-1237542ad61a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:45.794768 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:45.795254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:45.796104 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:45.796545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:45.811032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] HTTP exception thrown: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Request method failure captured: May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a HTTP/1.1 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABien630sv3SSiXrtu4TTF5j_1LoQ6EyyFcDcAyD9ZAf15JsCiQDGnX8OafZXs1bNcXMe9Ze5ezrn8esDnXBhCL46hhlTXYbxVllVRUwiXNmsBW80CA7FijC-LlzVYmrFaxI213asZW7Lll8d_hKDJsxrVe01csrkx7wIrpfaDASSHtVj8 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Openstack-Nova-Api-Version: 2.20 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:10:45.812573 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09c6a716650343c18e62bbe7235e48c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 09c6a716650343c18e62bbe7235e48c8 May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-751053882 May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: aa56c83ab8494901b85d00d4f592e5ce May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-751053882-project May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.814202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'a4aac7eb-fbec-4d86-82c9-1237542ad61a'} May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:10:45.815117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. May 10 15:10:45.816571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:10:45.817864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] Returning 404 to user: Instance a4aac7eb-fbec-4d86-82c9-1237542ad61a could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:10:45.817864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e6cc2534-f05e-4dc5-81a3-399c4ab8e8c2 tempest-AttachVolumeShelveTestJSON-751053882 tempest-AttachVolumeShelveTestJSON-751053882-project] 10.222.0.83 "GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a" status: 404 len: 111 microversion: 2.20 time: 0.031648 May 10 15:10:45.817864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 424/866] 10.222.0.83 () {60 vars in 1276 bytes} [Tue May 10 15:10:45 2022] GET /compute/v2.1/servers/a4aac7eb-fbec-4d86-82c9-1237542ad61a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 15:10:46.889742 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:46.890360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:46.896595 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:46.897052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:46.897819 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:46.898259 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:47.033186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:47.041565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-acc74f0f-f5ed-4989-9531-fa9bccdfc928 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1593 microversion: 2.1 time: 0.155579 May 10 15:10:47.042150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 443/867] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:46 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:49.020112 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-9628a33b-d1bc-4f69-bbd5-e4b37573e1f2 req-cc9945ae-9cf7-4c5d-80a9-6b46dc4feb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab178055-4b1f-4396-a555-7f196d8a076d", "tag": "03b834c1-546f-44db-a170-4f24b1f202fb"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:49.038080 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9628a33b-d1bc-4f69-bbd5-e4b37573e1f2 req-cc9945ae-9cf7-4c5d-80a9-6b46dc4feb62 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:49.038829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9628a33b-d1bc-4f69-bbd5-e4b37573e1f2 req-cc9945ae-9cf7-4c5d-80a9-6b46dc4feb62 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:49.070749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-9628a33b-d1bc-4f69-bbd5-e4b37573e1f2 req-cc9945ae-9cf7-4c5d-80a9-6b46dc4feb62 service nova] Creating event network-changed:03b834c1-546f-44db-a170-4f24b1f202fb for instance ab178055-4b1f-4396-a555-7f196d8a076d on hv-cinder-83962 May 10 15:10:49.086616 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-9628a33b-d1bc-4f69-bbd5-e4b37573e1f2 req-cc9945ae-9cf7-4c5d-80a9-6b46dc4feb62 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070136 May 10 15:10:49.089229 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 425/868] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:10:50.407401 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-189758739"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:50.408635 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:50.417438 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:50.418241 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:50.419362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:50.420020 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:50.588160 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.network.security_group_api [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Adding security group 298d7e8d-c402-49f2-975c-45399ab79ac0 to port 03b834c1-546f-44db-a170-4f24b1f202fb May 10 15:10:50.976722 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2cac187a-36e2-404a-9d8c-8e3fac558598 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/action" status: 202 len: 0 microversion: 2.1 time: 0.574444 May 10 15:10:50.977827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 444/869] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:10:50 2022] POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:10:50.989213 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:50.990222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:51.018052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:51.018466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:51.019250 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:51.019684 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:51.104722 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-4f1f9f54-6671-49de-b460-205a466243dd req-24654b4e-4fac-40b6-adcd-76dc29216de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab178055-4b1f-4396-a555-7f196d8a076d", "tag": "03b834c1-546f-44db-a170-4f24b1f202fb"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:51.118744 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-4f1f9f54-6671-49de-b460-205a466243dd req-24654b4e-4fac-40b6-adcd-76dc29216de1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:51.124744 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-4f1f9f54-6671-49de-b460-205a466243dd req-24654b4e-4fac-40b6-adcd-76dc29216de1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:51.138548 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-4f1f9f54-6671-49de-b460-205a466243dd req-24654b4e-4fac-40b6-adcd-76dc29216de1 service nova] Creating event network-changed:03b834c1-546f-44db-a170-4f24b1f202fb for instance ab178055-4b1f-4396-a555-7f196d8a076d on hv-cinder-83962 May 10 15:10:51.144464 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-4f1f9f54-6671-49de-b460-205a466243dd req-24654b4e-4fac-40b6-adcd-76dc29216de1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043299 May 10 15:10:51.145691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 445/870] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:10:51.237555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:51.246570 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-67a0c3ae-5ec2-467a-8a12-f02da9ac57a8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1757 microversion: 2.1 time: 0.263675 May 10 15:10:51.248032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 426/871] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:50 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:56.117649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b8d1f6f1-65cf-4e92-8340-cb48b1b61a10 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'create', calling method: .version_select at 0x7f7de5c3d670>, body: {"keypair": {"name": "tempest-keypair-550009401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNry4rDfonldTfiaaK9Z06IUbn5h6oGDpOiC1IYFeABbo8nnW9Jq/fX/0DlYyPcTJAmQ6kGT+VydeFgJfYGp3oEkHMcs3Kqhanuqs7BtjsTimZeWVRwiS0GO9t75pz5s8A=="}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:56.132444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-b8d1f6f1-65cf-4e92-8340-cb48b1b61a10 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for project 057df79ceee746d7bbd932006cca3ce5. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:10:56.136326 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-b8d1f6f1-65cf-4e92-8340-cb48b1b61a10 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for user 3b54ed811f2a46fc8c1a0235e06f9509 and project 057df79ceee746d7bbd932006cca3ce5. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:10:56.158632 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b8d1f6f1-65cf-4e92-8340-cb48b1b61a10 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164001 May 10 15:10:56.159251 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 446/872] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:10:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:10:57.381679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-164608010", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8dc7de5-a118-435c-91a1-f67ae4506cd5"}], "security_groups": [{"name": "tempest-securitygroup--184627163"}], "key_name": "tempest-keypair-550009401", "user_data": "}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:10:57.481862 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] validate_networks() for [('b8dc7de5-a118-435c-91a1-f67ae4506cd5', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:10:57.865134 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:10:57.865676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:10:57.866153 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:10:57.866602 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:10:57.870198 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:10:57.879814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:57.880443 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:57.881856 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:57.882294 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:57.900303 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for project 057df79ceee746d7bbd932006cca3ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:10:57.904423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for user 3b54ed811f2a46fc8c1a0235e06f9509 and project 057df79ceee746d7bbd932006cca3ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:10:57.922740 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:10:57.925249 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:10:57.976488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-795113fb-1f96-4d8c-b1de-2d11f3285073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599579 May 10 15:10:57.977456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 427/873] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:10:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:10:57.987679 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b5cab763-7107-484f-87fb-42f004495073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:57.989352 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b5cab763-7107-484f-87fb-42f004495073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:58.052014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b5cab763-7107-484f-87fb-42f004495073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:58.059896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b5cab763-7107-484f-87fb-42f004495073 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1236 microversion: 2.1 time: 0.076141 May 10 15:10:58.071819 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 447/874] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:57 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:10:59.077798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:10:59.078463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:10:59.086285 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:59.086852 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:59.087716 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:10:59.088166 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:10:59.173899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:10:59.181658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d072922e-6fe6-44f9-b03e-1406aa46442c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1288 microversion: 2.1 time: 0.108250 May 10 15:10:59.182228 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 428/875] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:10:59 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:00.198740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:00.199565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:00.208467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:00.209046 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:00.209850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:00.210487 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:00.279386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:00.286498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-5e427252-9c41-45ed-ab62-01d9510fc424 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1294 microversion: 2.1 time: 0.091712 May 10 15:11:00.287073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 448/876] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:00 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:01.085348 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-04fae023-b8f4-4cb8-9443-0be162707092 req-1de2362a-a16d-4f81-ade9-13acdaf1a781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179c4ae0-b9ad-47e7-9e4f-eceaf008c021", "tag": "016d01cb-1e3a-4f20-a375-93d38b570a44"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:01.097958 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-04fae023-b8f4-4cb8-9443-0be162707092 req-1de2362a-a16d-4f81-ade9-13acdaf1a781 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:01.098863 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-04fae023-b8f4-4cb8-9443-0be162707092 req-1de2362a-a16d-4f81-ade9-13acdaf1a781 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:01.111440 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-04fae023-b8f4-4cb8-9443-0be162707092 req-1de2362a-a16d-4f81-ade9-13acdaf1a781 service nova] Creating event network-changed:016d01cb-1e3a-4f20-a375-93d38b570a44 for instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 on hv-cinder-83962 May 10 15:11:01.117717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-04fae023-b8f4-4cb8-9443-0be162707092 req-1de2362a-a16d-4f81-ade9-13acdaf1a781 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036096 May 10 15:11:01.118707 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 429/877] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:11:01.268057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d0b7b831-9d54-4b59-b0d9-5698b01903da tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6803c1-f185-4753-8a45-0eab3dc46a08", "device": "/dev/sdb"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:01.269633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d0b7b831-9d54-4b59-b0d9-5698b01903da tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:01.276713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b831-9d54-4b59-b0d9-5698b01903da tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:01.277248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b831-9d54-4b59-b0d9-5698b01903da tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:01.278094 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b831-9d54-4b59-b0d9-5698b01903da tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:01.278572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b831-9d54-4b59-b0d9-5698b01903da tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:01.304903 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:01.305667 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:01.313774 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:01.314482 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:01.316028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:01.316484 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:01.461599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:01.469676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ba7de8d7-961e-4020-b1b6-8d1984cea14e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1361 microversion: 2.1 time: 0.169332 May 10 15:11:01.470247 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 430/878] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:01 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:11:01.554912 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d0b7b831-9d54-4b59-b0d9-5698b01903da tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "POST /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290695 May 10 15:11:01.555528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 449/879] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:11:01 2022] POST /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:11:02.486935 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:02.487541 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:02.494588 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:02.495039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:02.495804 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:02.496385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:02.637929 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:02.652323 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5599751b-62ba-480d-9c5f-29bc684c84be tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1361 microversion: 2.1 time: 0.169589 May 10 15:11:02.653113 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 431/880] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:02 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:03.670148 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:03.670793 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:03.676986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:03.677438 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:03.678738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:03.679175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:03.808404 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:03.815648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ff609a12-2c05-42a5-a582-30355e7467a0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1361 microversion: 2.1 time: 0.150200 May 10 15:11:03.816217 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 450/881] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:03 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:04.832125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:04.832733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:04.839642 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:04.840088 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:04.840848 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:04.841279 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:04.969629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:04.977528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2c2e599f-8130-42c5-b6a1-08965bb1fcd6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1361 microversion: 2.1 time: 0.149249 May 10 15:11:04.978171 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 432/882] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:04 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:05.994195 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:05.994828 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:06.001265 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:06.001708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:06.002489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:06.002919 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:06.130244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:06.137962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1c664c90-c8d1-426e-a7b0-3ffeaf75872f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1361 microversion: 2.1 time: 0.147617 May 10 15:11:06.138552 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 451/883] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:05 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:07.155960 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:07.156577 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:07.161459 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-98d8a6f0-3046-41a4-b287-58fa5fff7e55 req-ba7fc36a-a244-4f66-859e-aa1726943af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179c4ae0-b9ad-47e7-9e4f-eceaf008c021", "name": "network-vif-plugged", "status": "completed", "tag": "016d01cb-1e3a-4f20-a375-93d38b570a44"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:07.163915 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:07.164432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:07.165309 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:07.165804 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:07.170936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-98d8a6f0-3046-41a4-b287-58fa5fff7e55 req-ba7fc36a-a244-4f66-859e-aa1726943af1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:07.171375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-98d8a6f0-3046-41a4-b287-58fa5fff7e55 req-ba7fc36a-a244-4f66-859e-aa1726943af1 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:07.182737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-98d8a6f0-3046-41a4-b287-58fa5fff7e55 req-ba7fc36a-a244-4f66-859e-aa1726943af1 service nova] Creating event network-vif-plugged:016d01cb-1e3a-4f20-a375-93d38b570a44 for instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 on hv-cinder-83962 May 10 15:11:07.187742 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-98d8a6f0-3046-41a4-b287-58fa5fff7e55 req-ba7fc36a-a244-4f66-859e-aa1726943af1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029999 May 10 15:11:07.189113 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 452/884] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:11:07.304856 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:07.312265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fce31356-4300-417e-9e4a-5f5dbdc20716 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1361 microversion: 2.1 time: 0.160232 May 10 15:11:07.312846 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 433/885] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:07 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:08.330018 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:08.330750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:08.336966 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:08.337414 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:08.338181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:08.338654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:08.463197 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:08.470350 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-36f72ea1-43e5-4d84-84b4-b1cc79278d58 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1361 microversion: 2.1 time: 0.145019 May 10 15:11:08.470947 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 453/886] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:08 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:09.487623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:09.488164 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:09.494930 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:09.495380 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:09.496147 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:09.496585 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:09.628884 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:09.638826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c3facbfd-b50e-4a2f-aa13-74963de9f9fb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1546 microversion: 2.1 time: 0.155097 May 10 15:11:09.639406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 434/887] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:09 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:09.655080 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-952eed17-6dbd-4f87-bcf0-e35a86d82dd0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:09.655628 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-952eed17-6dbd-4f87-bcf0-e35a86d82dd0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:09.661805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-952eed17-6dbd-4f87-bcf0-e35a86d82dd0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:09.662279 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-952eed17-6dbd-4f87-bcf0-e35a86d82dd0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:09.663100 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-952eed17-6dbd-4f87-bcf0-e35a86d82dd0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:09.663528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-952eed17-6dbd-4f87-bcf0-e35a86d82dd0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:09.742505 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-952eed17-6dbd-4f87-bcf0-e35a86d82dd0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091175 May 10 15:11:09.743104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 454/888] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:11:09 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:11:10.710002 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-8252ada1-806d-4ee8-a2ff-a08293c6ed1e req-c72ccd1b-d8d9-4098-98df-dd5e10705079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179c4ae0-b9ad-47e7-9e4f-eceaf008c021", "tag": "016d01cb-1e3a-4f20-a375-93d38b570a44"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:10.718470 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8252ada1-806d-4ee8-a2ff-a08293c6ed1e req-c72ccd1b-d8d9-4098-98df-dd5e10705079 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:10.718922 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8252ada1-806d-4ee8-a2ff-a08293c6ed1e req-c72ccd1b-d8d9-4098-98df-dd5e10705079 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:10.729670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-8252ada1-806d-4ee8-a2ff-a08293c6ed1e req-c72ccd1b-d8d9-4098-98df-dd5e10705079 service nova] Creating event network-changed:016d01cb-1e3a-4f20-a375-93d38b570a44 for instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 on hv-cinder-83962 May 10 15:11:10.734692 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-8252ada1-806d-4ee8-a2ff-a08293c6ed1e req-c72ccd1b-d8d9-4098-98df-dd5e10705079 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028900 May 10 15:11:10.735288 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 435/889] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:11:16.846883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-143acd3f-2955-47e9-8075-73628dcec6f6 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:16.847929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-143acd3f-2955-47e9-8075-73628dcec6f6 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:16.853835 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-143acd3f-2955-47e9-8075-73628dcec6f6 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:16.854276 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-143acd3f-2955-47e9-8075-73628dcec6f6 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:16.855062 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-143acd3f-2955-47e9-8075-73628dcec6f6 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:16.855493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-143acd3f-2955-47e9-8075-73628dcec6f6 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:16.926087 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-143acd3f-2955-47e9-8075-73628dcec6f6 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/action" status: 202 len: 0 microversion: 2.1 time: 0.083444 May 10 15:11:16.929418 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 455/890] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:11:16 2022] POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:11:16.936650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:16.937435 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:16.944447 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:16.945023 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:16.945833 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:16.946297 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:17.084768 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:17.092667 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-662b7656-741b-4702-b02c-dfd6464bec7e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1749 microversion: 2.1 time: 0.160777 May 10 15:11:17.093254 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 436/891] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:16 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:18.110700 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:18.111436 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:18.117815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:18.118267 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:18.119054 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:18.119489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:18.266958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:18.275455 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a8672b36-2f74-44eb-a4e0-2db6332e1436 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.169080 May 10 15:11:18.276255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 456/892] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:18 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:19.295995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:19.296619 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:19.303662 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:19.304117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:19.304885 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:19.305321 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:19.443886 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:19.451664 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-bbf51f3d-0ed9-4108-ba2f-e9b44df0c866 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.159612 May 10 15:11:19.452234 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 437/893] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:19 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:20.468602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:20.469215 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:20.475545 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:20.475995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:20.476755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:20.477197 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:20.613991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:20.622427 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7447bbe4-f08c-40de-900c-cb1b96bcb9cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.157456 May 10 15:11:20.622995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 457/894] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:20 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:21.640085 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:21.640701 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:21.647810 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:21.648260 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:21.649030 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:21.649466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:21.787372 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:21.795154 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-75d402a7-4461-44ee-96fe-f126d54f0302 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.158952 May 10 15:11:21.795718 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 438/895] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:21 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:22.812855 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:22.813470 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:22.819870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:22.820317 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:22.821078 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:22.821514 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:23.227657 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:23.235373 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c477b2c6-e5fc-46e5-9d70-b25daa03c54a tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.426419 May 10 15:11:23.235938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 458/896] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:22 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:24.253829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:24.254359 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:24.260778 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:24.261230 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:24.261992 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:24.262454 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:24.400998 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:24.408798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-68c6d833-87ed-4356-85cd-0142229119f1 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.158935 May 10 15:11:24.409368 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 439/897] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:24 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:25.431157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:25.431789 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:25.440438 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:25.440896 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:25.442162 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:25.442641 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:25.584771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:25.592748 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7ddc535f-c9db-4fc8-a485-38ee2a99a984 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.168835 May 10 15:11:25.593357 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 459/898] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:25 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:26.173565 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:26.174061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:26.180321 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:26.180777 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:26.181545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:26.181986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:26.260572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lazy-loading 'services' on Instance uuid 541fd5f4-f3ef-4a42-b50e-a625f2e17734 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:11:26.329275 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-96b8289e-e857-4caf-b5d0-8e0d66a6f34f tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "DELETE /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734/os-volume_attachments/6c6803c1-f185-4753-8a45-0eab3dc46a08" status: 202 len: 0 microversion: 2.1 time: 0.159473 May 10 15:11:26.329954 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 440/899] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:11:26 2022] DELETE /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734/os-volume_attachments/6c6803c1-f185-4753-8a45-0eab3dc46a08 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:11:26.610886 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:26.611503 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:26.618512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:26.618963 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:26.619737 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:26.620183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:26.760191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:26.768086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-304d72ea-9b8a-4739-b547-ec0589dde8b7 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.161139 May 10 15:11:26.768657 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 460/900] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:26 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:27.438675 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:27.439261 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:27.445571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:27.446017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:27.446838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:27.447298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:27.470783 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:11:27.542118 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4c27170a-86e4-459d-b9dc-19152d7e72e5 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "DELETE /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 204 len: 0 microversion: 2.1 time: 0.107864 May 10 15:11:27.542714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 441/901] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:11:27 2022] DELETE /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:11:27.550709 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:27.551327 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:27.557683 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:27.558133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:27.558937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:27.559374 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:27.684571 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:27.691783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f8dcd986-b7e4-4cbc-902e-e86fd40c4432 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1512 microversion: 2.1 time: 0.144959 May 10 15:11:27.692353 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 461/902] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:27 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:27.785380 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:27.786076 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:27.792673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:27.793117 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:27.793874 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:27.794308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:27.935413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:27.943115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b496dd45-c2b7-4cee-91c8-e7fdda686257 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.161955 May 10 15:11:27.943672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 442/903] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:27 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:28.708779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:28.709344 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:28.715671 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:28.716122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:28.716881 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:28.717319 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:28.844055 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:28.851295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-cf2aa6b3-1041-4ac8-b630-110e7936d92a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1512 microversion: 2.1 time: 0.146490 May 10 15:11:28.851873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 462/904] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:28 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:28.959364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:28.959927 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:28.966197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:28.966687 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:28.967464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:28.967904 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:29.105231 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:29.113248 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-308e4d70-f819-4e27-8874-de14a9149ea8 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.157880 May 10 15:11:29.113815 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 443/905] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:28 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:29.868116 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:29.868851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:29.875366 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:29.875821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:29.876582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:29.877014 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:29.967614 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:29.975351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-519bc2fb-47ef-49a6-84d8-a126199c020d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 200 len: 1470 microversion: 2.1 time: 0.110686 May 10 15:11:29.982457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 463/906] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:29 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 1470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:30.042532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-c5ab03f8-d83d-413e-8a1b-aac57f33c462 req-549a2f35-27af-4ffc-bbbc-8254e86a667a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541fd5f4-f3ef-4a42-b50e-a625f2e17734", "name": "network-vif-deleted", "tag": "e8eb5d12-4d65-4ec1-9bb7-842395fec078"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:30.051136 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-c5ab03f8-d83d-413e-8a1b-aac57f33c462 req-549a2f35-27af-4ffc-bbbc-8254e86a667a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:30.051571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-c5ab03f8-d83d-413e-8a1b-aac57f33c462 req-549a2f35-27af-4ffc-bbbc-8254e86a667a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:30.063487 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-c5ab03f8-d83d-413e-8a1b-aac57f33c462 req-549a2f35-27af-4ffc-bbbc-8254e86a667a service nova] Creating event network-vif-deleted:e8eb5d12-4d65-4ec1-9bb7-842395fec078 for instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 on hv-cinder-83962 May 10 15:11:30.068852 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-c5ab03f8-d83d-413e-8a1b-aac57f33c462 req-549a2f35-27af-4ffc-bbbc-8254e86a667a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029667 May 10 15:11:30.069445 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 444/907] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:11:30.132114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:30.132642 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:30.138681 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:30.139130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:30.139908 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:30.140435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:30.285539 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:30.293518 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1f91e697-9806-47d9-a13e-c723123f3593 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.165908 May 10 15:11:30.294104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 464/908] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:30 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:30.992261 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:30.992962 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 541fd5f4-f3ef-4a42-b50e-a625f2e17734] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:30.999491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:30.999945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:31.000707 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:31.001169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:31.015751 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] HTTP exception thrown: Instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 could not be found. May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Request method failure captured: May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 HTTP/1.1 May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoBpKeR2EqBzYXu_yNsJC79j7KawmWeJh2d3xnZGFD9LaYoxtrT4q07IK5MwRNScoU16T29vu1f5emVGasi6FW6KFmmazJLXwQ0sIwDCrwKeB3fHuHkZuYtp6xvfhH99IHQI3eqa7wUfMGmAsODcUZuyI2pXwuocJM1PCo-URKxkBEw May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 870b2a5de87144f58bdd6aebe78a3e47 May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1531479558 May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:11:31.017351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-VolumesSnapshotTestJSON-1531479558 May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 870b2a5de87144f58bdd6aebe78a3e47 May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1531479558 May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-VolumesSnapshotTestJSON-1531479558-project May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: d4fb5382ce0d4e3694f4c434afc39d94 May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-VolumesSnapshotTestJSON-1531479558-project May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 could not be found. May 10 15:11:31.019061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '541fd5f4-f3ef-4a42-b50e-a625f2e17734'} May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 could not be found. May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:11:31.019986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 could not be found. May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 could not be found. May 10 15:11:31.022108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:11:31.023517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Returning 404 to user: Instance 541fd5f4-f3ef-4a42-b50e-a625f2e17734 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:11:31.023517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cb58d44a-f1a5-4a88-8f63-cfc1a1b96941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734" status: 404 len: 111 microversion: 2.1 time: 0.030717 May 10 15:11:31.023517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 445/909] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:30 2022] GET /compute/v2.1/servers/541fd5f4-f3ef-4a42-b50e-a625f2e17734 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:11:31.312917 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:31.314078 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:31.325783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:31.326331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:31.327393 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:31.327839 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:31.465258 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:31.473051 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a05df521-7f96-4108-8897-8224ea9753fc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.165917 May 10 15:11:31.473623 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 465/910] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:31 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:32.490551 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:32.491167 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:32.497678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:32.498163 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:32.498949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:32.499387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:32.639997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:32.648419 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d4e5fbee-9ce5-4633-9dc0-d91afeff58f5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.161865 May 10 15:11:32.648979 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 446/911] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:32 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:33.665378 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:33.665996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:33.672295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:33.672746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:33.673508 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:33.673944 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:33.821272 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:33.829066 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-580173c3-1272-40b4-a9c5-7ba5005e2df5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.168004 May 10 15:11:33.829631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 466/912] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:33 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:34.846363 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:34.846998 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:34.853306 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:34.853754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:34.854544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:34.855010 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:34.994422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:35.002474 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e645a97c-2b9b-40cd-93af-cf20c1756737 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1754 microversion: 2.1 time: 0.159938 May 10 15:11:35.003080 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 447/913] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:34 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:36.019072 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:36.019680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:36.026362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:36.026841 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:36.027596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:36.028026 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:36.166512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:36.174342 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-97301874-a0ae-4260-b399-ca75d5a4c8e2 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1757 microversion: 2.1 time: 0.159133 May 10 15:11:36.174884 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 467/914] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:36 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:38.771954 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1401603880", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "networks": [{"uuid": "13b607e0-34f7-439f-ac23-0cdae73d5c42"}]}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:38.823969 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] validate_networks() for [('13b607e0-34f7-439f-ac23-0cdae73d5c42', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:11:39.152223 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:11:39.152646 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:11:39.153115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:11:39.153541 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:11:39.153949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:11:39.163012 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:39.163450 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:39.164241 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:39.164670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:39.180327 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Getting quotas for project 870b2a5de87144f58bdd6aebe78a3e47. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:11:39.184122 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Getting quotas for user d4fb5382ce0d4e3694f4c434afc39d94 and project 870b2a5de87144f58bdd6aebe78a3e47. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:11:39.194624 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:11:39.196811 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:11:39.241337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-aae4eb16-71f7-4abc-a77f-474efc7af1fd tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.473218 May 10 15:11:39.242084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 448/915] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:11:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:11:39.252041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4774feb6-be6c-4467-9dc4-f0a35cda4e41 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:39.252650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4774feb6-be6c-4467-9dc4-f0a35cda4e41 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:39.306669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4774feb6-be6c-4467-9dc4-f0a35cda4e41 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:39.313030 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4774feb6-be6c-4467-9dc4-f0a35cda4e41 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1219 microversion: 2.1 time: 0.064794 May 10 15:11:39.313606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 468/916] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:39 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:40.330067 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:40.330792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:40.337784 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:40.338657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:40.339447 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:40.340057 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:40.413711 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:40.421054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e7b299e8-d525-41f9-a036-dd23c3537fe6 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1279 microversion: 2.1 time: 0.095653 May 10 15:11:40.421629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 449/917] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:40 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:41.438414 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:41.439123 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:41.446222 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:41.446698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:41.447466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:41.447901 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:41.613045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-8db7704c-8935-4fa2-b87d-46d4a026f3ce req-7916fd82-0443-4478-bbd4-067720db7c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b32975-0c41-42ca-ad17-ac39ae077841", "tag": "48d39522-3822-429e-9d3f-041279779566"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:41.621575 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8db7704c-8935-4fa2-b87d-46d4a026f3ce req-7916fd82-0443-4478-bbd4-067720db7c7d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:41.622435 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-8db7704c-8935-4fa2-b87d-46d4a026f3ce req-7916fd82-0443-4478-bbd4-067720db7c7d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:41.634367 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-8db7704c-8935-4fa2-b87d-46d4a026f3ce req-7916fd82-0443-4478-bbd4-067720db7c7d service nova] Creating event network-changed:48d39522-3822-429e-9d3f-041279779566 for instance 93b32975-0c41-42ca-ad17-ac39ae077841 on hv-cinder-83962 May 10 15:11:41.639417 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-8db7704c-8935-4fa2-b87d-46d4a026f3ce req-7916fd82-0443-4478-bbd4-067720db7c7d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030136 May 10 15:11:41.640032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 450/918] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:11:41.684788 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:41.693244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c13fbde1-b1fe-47c5-8b25-44808d2e0941 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1319 microversion: 2.1 time: 0.258013 May 10 15:11:41.694027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 469/919] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:41 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:42.712252 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:42.712856 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:42.719094 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:42.719548 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:42.720318 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:42.720759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:42.845307 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:42.852570 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-78e2bfda-24d8-401f-bcfc-7b9b164ccf7d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1319 microversion: 2.1 time: 0.145760 May 10 15:11:42.853141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 451/920] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:42 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:43.868654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:43.869257 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:43.875849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:43.876297 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:43.877061 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:43.877497 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:44.002175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:44.009795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-53cde0c5-75fd-4ded-970c-d43ef29bd208 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1319 microversion: 2.1 time: 0.145036 May 10 15:11:44.010362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 470/921] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:43 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:45.026009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:45.026660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:45.033093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:45.033542 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:45.034318 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:45.034986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:45.171095 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:45.178283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6b49ce4f-db24-4971-a134-6b9588e0038d tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1319 microversion: 2.1 time: 0.156194 May 10 15:11:45.178873 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 452/922] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:45 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:46.194761 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:46.195289 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:46.201562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:46.202013 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:46.202812 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:46.203249 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:46.326472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:46.333606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d6f07bd0-3b9c-4088-94e7-13ceca5576b2 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1319 microversion: 2.1 time: 0.142795 May 10 15:11:46.334173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 471/923] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:46 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:47.350224 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:47.350902 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:47.357129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:47.357575 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:47.358337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:47.358798 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:47.373472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-959ddcb3-9b46-443c-ab98-dbabe22bdb28 req-977fe8f3-3a25-44c5-a7c5-8cc96173f097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b32975-0c41-42ca-ad17-ac39ae077841", "name": "network-vif-plugged", "status": "completed", "tag": "48d39522-3822-429e-9d3f-041279779566"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:47.384229 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-959ddcb3-9b46-443c-ab98-dbabe22bdb28 req-977fe8f3-3a25-44c5-a7c5-8cc96173f097 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:47.384697 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-959ddcb3-9b46-443c-ab98-dbabe22bdb28 req-977fe8f3-3a25-44c5-a7c5-8cc96173f097 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:47.398035 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-959ddcb3-9b46-443c-ab98-dbabe22bdb28 req-977fe8f3-3a25-44c5-a7c5-8cc96173f097 service nova] Creating event network-vif-plugged:48d39522-3822-429e-9d3f-041279779566 for instance 93b32975-0c41-42ca-ad17-ac39ae077841 on hv-cinder-83962 May 10 15:11:47.403471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-959ddcb3-9b46-443c-ab98-dbabe22bdb28 req-977fe8f3-3a25-44c5-a7c5-8cc96173f097 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033817 May 10 15:11:47.404480 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 472/924] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:11:47.504932 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:47.513361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-08a9493a-f04d-4258-9e72-940d1ca9c8c1 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1319 microversion: 2.1 time: 0.166990 May 10 15:11:47.513930 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 453/925] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:47 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:48.530576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:48.531285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:48.537454 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:48.537909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:48.538726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:48.539168 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:48.663755 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:48.671032 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8face397-ebb2-4017-9a3f-4df28aa3b2ba tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1319 microversion: 2.1 time: 0.145191 May 10 15:11:48.671605 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 473/926] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:48 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:49.687588 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:49.688194 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:49.694479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:49.694933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:49.695729 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:49.696165 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:49.825678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:11:49.833003 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b438abd7-8aff-4346-a950-a838f89c7786 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1507 microversion: 2.1 time: 0.149344 May 10 15:11:49.833845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 454/927] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:11:49 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:11:49.849546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0e2fb45b-77c6-48c2-b2a7-be37a7923a26 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "684e4bcb-30c2-4d11-b37b-e311310c7529", "device": "/dev/sdb"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:11:49.850753 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0e2fb45b-77c6-48c2-b2a7-be37a7923a26 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:49.857098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e2fb45b-77c6-48c2-b2a7-be37a7923a26 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:49.857543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e2fb45b-77c6-48c2-b2a7-be37a7923a26 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:49.858298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e2fb45b-77c6-48c2-b2a7-be37a7923a26 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:49.858757 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e2fb45b-77c6-48c2-b2a7-be37a7923a26 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:50.092855 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0e2fb45b-77c6-48c2-b2a7-be37a7923a26 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "POST /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247056 May 10 15:11:50.093466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 474/928] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:11:49 2022] POST /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:11:57.216497 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ef7be392-a717-4c70-9c94-6eb5fa8349ac tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:11:57.217066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ef7be392-a717-4c70-9c94-6eb5fa8349ac tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:11:57.223274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ef7be392-a717-4c70-9c94-6eb5fa8349ac tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:57.223725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ef7be392-a717-4c70-9c94-6eb5fa8349ac tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:57.224491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ef7be392-a717-4c70-9c94-6eb5fa8349ac tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:11:57.224927 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ef7be392-a717-4c70-9c94-6eb5fa8349ac tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:11:57.247778 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ef7be392-a717-4c70-9c94-6eb5fa8349ac tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/ips" status: 200 len: 145 microversion: 2.1 time: 0.034921 May 10 15:11:57.248344 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 455/929] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:11:57 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:02.900805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c0f3ca23-7fc7-4bae-9255-94b91a0d4c1f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53af34c9-3c8c-40ac-b840-0b03810f7fff"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:02.901949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c0f3ca23-7fc7-4bae-9255-94b91a0d4c1f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:02.908052 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c0f3ca23-7fc7-4bae-9255-94b91a0d4c1f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:02.908512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c0f3ca23-7fc7-4bae-9255-94b91a0d4c1f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:02.909288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c0f3ca23-7fc7-4bae-9255-94b91a0d4c1f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:02.909729 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c0f3ca23-7fc7-4bae-9255-94b91a0d4c1f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:05.350848 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c0f3ca23-7fc7-4bae-9255-94b91a0d4c1f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.455313 May 10 15:12:05.351523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 475/930] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:12:02 2022] POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-volume_attachments => generated 194 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:09.334731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:09.335220 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:09.341590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:09.342039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:09.342870 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:09.343311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:09.419623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lazy-loading 'services' on Instance uuid 93b32975-0c41-42ca-ad17-ac39ae077841 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:12:09.488130 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6ca9c001-af53-4d26-a094-6b7a96cedd7a tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841/os-volume_attachments/684e4bcb-30c2-4d11-b37b-e311310c7529" status: 202 len: 0 microversion: 2.1 time: 0.157306 May 10 15:12:09.488763 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 456/931] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:12:09 2022] DELETE /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841/os-volume_attachments/684e4bcb-30c2-4d11-b37b-e311310c7529 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:12:12.706007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:12.706625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:12.713133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:12.713584 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:12.714359 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:12.714824 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:12.739496 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:12:12.813933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8c5ce2e1-a4cc-4e98-a15d-0d85a45ff142 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 204 len: 0 microversion: 2.1 time: 0.111769 May 10 15:12:12.825462 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 476/932] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:12:12 2022] DELETE /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:12:12.825641 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:12.826090 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:12.831077 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8b7af037-93fa-4bb1-aa48-03fde6d50342 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:12.832163 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:12.832618 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:12.833638 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:12.834083 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:12.837333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8b7af037-93fa-4bb1-aa48-03fde6d50342 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:12.837778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8b7af037-93fa-4bb1-aa48-03fde6d50342 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:12.898038 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8b7af037-93fa-4bb1-aa48-03fde6d50342 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Going to try to stop instance {{(pid=117167) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 15:12:12.945033 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8b7af037-93fa-4bb1-aa48-03fde6d50342 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action" status: 202 len: 0 microversion: 2.1 time: 0.117804 May 10 15:12:12.945765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 477/933] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:12:12 2022] POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 15:12:12.954310 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:12.955029 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:12.961074 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:12.961529 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:12.962330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:12.963408 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:12.969247 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:12.976772 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ec5fa05d-e6bf-4133-88e2-b5b9ebdf45b0 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1513 microversion: 2.1 time: 0.157151 May 10 15:12:12.977365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 457/934] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:12 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:13.096223 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:13.104648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-73e470f7-6b0a-422f-847f-354b2280769c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.154366 May 10 15:12:13.105225 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 478/935] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:12 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:13.993611 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:13.994232 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:14.000831 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:14.001286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:14.002046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:14.002513 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:14.121713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:14.122726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:14.126269 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:14.129010 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:14.129499 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:14.130272 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:14.130733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:14.133999 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b8d482cd-adc2-4876-8d33-a4bf0ca8ea8e tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1513 microversion: 2.1 time: 0.144825 May 10 15:12:14.135368 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 458/936] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:13 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:14.253995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:14.261685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0faca627-7a44-443f-890d-049f5bf37c35 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.144635 May 10 15:12:14.262284 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 479/937] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:14 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:15.151272 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:15.151913 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:15.158181 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:15.158677 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:15.159445 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:15.159884 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:15.279083 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:15.279686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:15.286098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:15.286595 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:15.287380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:15.287820 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:15.296753 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:15.307463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-83b7fdf4-e6b6-4953-9496-89fc261a2f17 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1513 microversion: 2.1 time: 0.160009 May 10 15:12:15.316666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 459/938] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:15 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:15.505141 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:15.512966 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9556d7b6-14a0-475d-8b7c-df424cbb19e4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.238538 May 10 15:12:15.513550 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 480/939] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:15 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:15.772194 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-6e21b3c0-2558-4b08-afdd-910b6b8a7448 req-92422d14-7e5a-4806-a547-7750d2946f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b32975-0c41-42ca-ad17-ac39ae077841", "name": "network-vif-deleted", "tag": "48d39522-3822-429e-9d3f-041279779566"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:15.781109 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-6e21b3c0-2558-4b08-afdd-910b6b8a7448 req-92422d14-7e5a-4806-a547-7750d2946f3d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:15.781544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-6e21b3c0-2558-4b08-afdd-910b6b8a7448 req-92422d14-7e5a-4806-a547-7750d2946f3d service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:15.795802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-6e21b3c0-2558-4b08-afdd-910b6b8a7448 req-92422d14-7e5a-4806-a547-7750d2946f3d service nova] Creating event network-vif-deleted:48d39522-3822-429e-9d3f-041279779566 for instance 93b32975-0c41-42ca-ad17-ac39ae077841 on hv-cinder-83962 May 10 15:12:15.800788 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-6e21b3c0-2558-4b08-afdd-910b6b8a7448 req-92422d14-7e5a-4806-a547-7750d2946f3d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032213 May 10 15:12:15.801406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 460/940] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:16.325439 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:16.326147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:16.332570 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:16.333119 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:16.333964 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:16.334434 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:16.367532 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:16.368589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:16.369046 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lazy-loading 'fault' on Instance uuid 93b32975-0c41-42ca-ad17-ac39ae077841 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:12:16.412192 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4fb5382ce0d4e3694f4c434afc39d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b2a5de87144f58bdd6aebe78a3e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:16.419000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0068d218-9897-4dde-88b7-a0ee5db48627 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 200 len: 1309 microversion: 2.1 time: 0.098673 May 10 15:12:16.419580 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 481/941] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:16 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:16.531017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:16.531640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:16.537796 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:16.538242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:16.539024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:16.539456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:16.666734 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:16.675898 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c4775624-2b62-448c-91f2-1a175c896b57 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.149606 May 10 15:12:16.676520 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 461/942] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:16 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:17.435623 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:17.436236 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] [instance: 93b32975-0c41-42ca-ad17-ac39ae077841] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:17.442867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:17.443312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:17.444226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:17.444671 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:17.458250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] HTTP exception thrown: Instance 93b32975-0c41-42ca-ad17-ac39ae077841 could not be found. May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Request method failure captured: May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 HTTP/1.1 May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoBpKeR2EqBzYXu_yNsJC79j7KawmWeJh2d3xnZGFD9LaYoxtrT4q07IK5MwRNScoU16T29vu1f5emVGasi6FW6KFmmazJLXwQ0sIwDCrwKeB3fHuHkZuYtp6xvfhH99IHQI3eqa7wUfMGmAsODcUZuyI2pXwuocJM1PCo-URKxkBEw May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 870b2a5de87144f58bdd6aebe78a3e47 May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1531479558 May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:12:17.459996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/870b2a5de87144f58bdd6aebe78a3e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-VolumesSnapshotTestJSON-1531479558 May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 870b2a5de87144f58bdd6aebe78a3e47 May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1531479558 May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-VolumesSnapshotTestJSON-1531479558-project May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: d4fb5382ce0d4e3694f4c434afc39d94 May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-VolumesSnapshotTestJSON-1531479558-project May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 93b32975-0c41-42ca-ad17-ac39ae077841 could not be found. May 10 15:12:17.462199 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '93b32975-0c41-42ca-ad17-ac39ae077841'} May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b32975-0c41-42ca-ad17-ac39ae077841 could not be found. May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:12:17.463103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b32975-0c41-42ca-ad17-ac39ae077841 could not be found. May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b32975-0c41-42ca-ad17-ac39ae077841 could not be found. May 10 15:12:17.464435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:17.465733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] Returning 404 to user: Instance 93b32975-0c41-42ca-ad17-ac39ae077841 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:12:17.465733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-00760a5d-7c72-4695-a040-1b7ccd7f8e38 tempest-VolumesSnapshotTestJSON-1531479558 tempest-VolumesSnapshotTestJSON-1531479558-project] 10.222.0.83 "GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841" status: 404 len: 111 microversion: 2.1 time: 0.029853 May 10 15:12:17.465733 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 482/943] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:17 2022] GET /compute/v2.1/servers/93b32975-0c41-42ca-ad17-ac39ae077841 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:12:17.695489 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:17.696635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:17.704184 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:17.704888 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:17.705601 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:17.706034 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:17.842174 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:17.850246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a7143eb0-ba9c-41f9-9a37-be1d343571dc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.160470 May 10 15:12:17.850845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 462/944] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:17 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:18.866872 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:18.867601 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:18.874221 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:18.874719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:18.875494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:18.875932 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:19.023863 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:19.032229 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0c9a3134-c93a-4e8c-bad5-e23fd556baa8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.169202 May 10 15:12:19.032802 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 483/945] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:18 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:20.049372 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:20.050067 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:20.057999 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:20.058526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:20.059308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:20.059808 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:20.192213 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:20.200747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a1f67998-955e-4ecd-88a3-0bbb86943454 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.155346 May 10 15:12:20.201319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 463/946] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:20 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:21.217533 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:21.218142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:21.224502 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:21.224947 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:21.225708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:21.226138 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:21.364298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:21.372131 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f972febf-8d62-48e0-bcb0-a3a1e550c011 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.158446 May 10 15:12:21.372961 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 484/947] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:21 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:22.391607 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:22.392231 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:22.398457 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:22.398918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:22.400212 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:22.400653 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:22.528863 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:22.536723 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-4bc76ad2-1f95-4785-b795-56624fe001c6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.148978 May 10 15:12:22.537294 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 464/948] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:22 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:23.553630 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:23.554254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:23.561076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:23.561523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:23.562285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:23.562757 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:23.705951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:23.714255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-945d51ac-b315-4289-a748-5a3361a0b983 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.164403 May 10 15:12:23.714860 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 485/949] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:23 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:24.193556 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-189758739"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:24.194097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:24.200343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:24.200790 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:24.201544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:24.201978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:24.326366 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.network.security_group_api [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Removing security group 298d7e8d-c402-49f2-975c-45399ab79ac0 from port 03b834c1-546f-44db-a170-4f24b1f202fb May 10 15:12:24.698021 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-294b0a3f-243b-46ee-83fa-532a992c2374 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/action" status: 202 len: 0 microversion: 2.1 time: 0.508426 May 10 15:12:24.701617 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 465/950] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:12:24 2022] POST /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:12:24.719785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-ba1d5ab7-dfd6-4846-8b7e-b05c93cdbdf2 req-c383f469-969c-4f7a-921e-1a2bdb64c96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab178055-4b1f-4396-a555-7f196d8a076d", "tag": "03b834c1-546f-44db-a170-4f24b1f202fb"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:24.733146 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:24.733693 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:24.741362 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:24.741679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:24.750813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:24.751460 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:24.752392 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-ba1d5ab7-dfd6-4846-8b7e-b05c93cdbdf2 req-c383f469-969c-4f7a-921e-1a2bdb64c96b service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:24.754368 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-ba1d5ab7-dfd6-4846-8b7e-b05c93cdbdf2 req-c383f469-969c-4f7a-921e-1a2bdb64c96b service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:24.792310 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-ba1d5ab7-dfd6-4846-8b7e-b05c93cdbdf2 req-c383f469-969c-4f7a-921e-1a2bdb64c96b service nova] Creating event network-changed:03b834c1-546f-44db-a170-4f24b1f202fb for instance ab178055-4b1f-4396-a555-7f196d8a076d on hv-cinder-83962 May 10 15:12:24.818472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-ba1d5ab7-dfd6-4846-8b7e-b05c93cdbdf2 req-c383f469-969c-4f7a-921e-1a2bdb64c96b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102094 May 10 15:12:24.825309 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 486/951] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:24.983337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:24.997522 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6b2cc74b-50cd-4b0b-abb0-df7ab1d7344b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.270084 May 10 15:12:24.999193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 466/952] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:24 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:26.016750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:26.017640 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:26.024687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:26.025331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:26.026280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:26.026976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:26.174316 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:26.184624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-498a5dd0-655c-4f5c-929a-349cf26f8a66 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.172570 May 10 15:12:26.194084 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 487/953] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:26 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:26.212830 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:26.213365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:26.219686 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:26.220140 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:26.220912 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:26.221352 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:26.300492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lazy-loading 'services' on Instance uuid ab178055-4b1f-4396-a555-7f196d8a076d {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:12:26.368658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9d924462-fa2d-451f-87d1-d9b743cdd840 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments/e7daab3e-9a28-404a-9fef-2b3ed8090b70" status: 202 len: 0 microversion: 2.1 time: 0.159313 May 10 15:12:26.369552 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 467/954] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:12:26 2022] DELETE /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments/e7daab3e-9a28-404a-9fef-2b3ed8090b70 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:12:26.378695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c2643eb7-3fa5-4e63-b49e-6c5b87ad9676 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:26.379602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c2643eb7-3fa5-4e63-b49e-6c5b87ad9676 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:26.386669 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c2643eb7-3fa5-4e63-b49e-6c5b87ad9676 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:26.387142 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c2643eb7-3fa5-4e63-b49e-6c5b87ad9676 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:26.388079 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c2643eb7-3fa5-4e63-b49e-6c5b87ad9676 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:26.388698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c2643eb7-3fa5-4e63-b49e-6c5b87ad9676 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:26.418186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c2643eb7-3fa5-4e63-b49e-6c5b87ad9676 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 May 10 15:12:26.418786 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 488/955] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:12:26 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:26.839033 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-9717df25-01e7-4c45-9290-a898d6d2911b req-fbfb4622-0668-4ce6-b748-a2a852d4bdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab178055-4b1f-4396-a555-7f196d8a076d", "tag": "03b834c1-546f-44db-a170-4f24b1f202fb"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:26.847208 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9717df25-01e7-4c45-9290-a898d6d2911b req-fbfb4622-0668-4ce6-b748-a2a852d4bdbd service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:26.847680 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-9717df25-01e7-4c45-9290-a898d6d2911b req-fbfb4622-0668-4ce6-b748-a2a852d4bdbd service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:26.859433 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-9717df25-01e7-4c45-9290-a898d6d2911b req-fbfb4622-0668-4ce6-b748-a2a852d4bdbd service nova] Creating event network-changed:03b834c1-546f-44db-a170-4f24b1f202fb for instance ab178055-4b1f-4396-a555-7f196d8a076d on hv-cinder-83962 May 10 15:12:26.864681 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-9717df25-01e7-4c45-9290-a898d6d2911b req-fbfb4622-0668-4ce6-b748-a2a852d4bdbd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029660 May 10 15:12:26.865522 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 468/956] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:27.200712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:27.201334 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:27.207721 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:27.208178 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:27.208950 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:27.209395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:27.337903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:27.345747 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b0aa92a8-a783-4c6a-8a1d-939b3a06cc6a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.148870 May 10 15:12:27.346327 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 489/957] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:27 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:27.430223 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3a731f64-427c-4e60-b6c8-655625518a0b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:27.431193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3a731f64-427c-4e60-b6c8-655625518a0b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:27.437321 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a731f64-427c-4e60-b6c8-655625518a0b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:27.437766 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a731f64-427c-4e60-b6c8-655625518a0b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:27.438571 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a731f64-427c-4e60-b6c8-655625518a0b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:27.438988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a731f64-427c-4e60-b6c8-655625518a0b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:27.467063 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3a731f64-427c-4e60-b6c8-655625518a0b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 May 10 15:12:27.467599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 469/958] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:12:27 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:28.364740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:28.365367 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:28.371786 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:28.372236 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:28.373265 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:28.373698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:28.478523 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7cbc44f2-5a56-4690-9d69-94ade8bd2409 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:28.479453 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7cbc44f2-5a56-4690-9d69-94ade8bd2409 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:28.485716 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cbc44f2-5a56-4690-9d69-94ade8bd2409 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:28.486166 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cbc44f2-5a56-4690-9d69-94ade8bd2409 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:28.486962 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cbc44f2-5a56-4690-9d69-94ade8bd2409 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:28.487396 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7cbc44f2-5a56-4690-9d69-94ade8bd2409 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:28.499986 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:28.507760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c88eaae2-675e-4140-9dfd-8924b503e263 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.147362 May 10 15:12:28.508345 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 490/959] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:28 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:28.516845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7cbc44f2-5a56-4690-9d69-94ade8bd2409 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042232 May 10 15:12:28.517391 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 470/960] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:12:28 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:12:29.525714 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:29.526524 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:29.528714 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-18da31cf-e7aa-4768-85f7-55b7d5df4541 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:29.529674 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-18da31cf-e7aa-4768-85f7-55b7d5df4541 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:29.534172 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:29.534608 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:29.535391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:29.535671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18da31cf-e7aa-4768-85f7-55b7d5df4541 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:29.535996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:29.536123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18da31cf-e7aa-4768-85f7-55b7d5df4541 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:29.536999 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18da31cf-e7aa-4768-85f7-55b7d5df4541 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:29.537444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18da31cf-e7aa-4768-85f7-55b7d5df4541 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:29.566547 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-18da31cf-e7aa-4768-85f7-55b7d5df4541 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042407 May 10 15:12:29.567977 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 471/961] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:12:29 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:12:29.737843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:29.745765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-4ba8e126-beeb-46da-ac5b-51565991ae59 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.224620 May 10 15:12:29.746342 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 491/962] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:29 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:30.577498 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c909d542-1645-45f4-8047-e28afabae17e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:30.578791 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c909d542-1645-45f4-8047-e28afabae17e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:30.584976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c909d542-1645-45f4-8047-e28afabae17e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:30.585414 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c909d542-1645-45f4-8047-e28afabae17e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:30.586259 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c909d542-1645-45f4-8047-e28afabae17e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:30.586823 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c909d542-1645-45f4-8047-e28afabae17e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:30.616410 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c909d542-1645-45f4-8047-e28afabae17e tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043110 May 10 15:12:30.617157 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 472/963] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:12:30 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:12:30.627840 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:30.628343 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:30.635034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:30.635489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:30.636263 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:30.636799 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:30.708150 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] HTTP exception thrown: Instance ab178055-4b1f-4396-a555-7f196d8a076d is not attached to volume e7daab3e-9a28-404a-9fef-2b3ed8090b70 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Request method failure captured: May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: DELETE /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments/e7daab3e-9a28-404a-9fef-2b3ed8090b70 HTTP/1.1 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoBFIIAGMOsGKz2UtQNA_rsrG6Ftm7_Hvo3AMzsIMyb3OvrVzAvWrSojeVlnlFExILr4fYkUC4hPwNIQpJV-j-nGhdHPskQwKB5vTeHx04Nvp-BnN3w6aLc6-6OH73brF6GB05JlwIrj4WJmEBNfAN9708laQvrYN61PRr6bbTBVME8 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 69cc7901bd8e4ff68b7e943121e69580 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-TestMinimumBasicScenario-772461889 May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:12:30.715854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-TestMinimumBasicScenario-772461889 May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 69cc7901bd8e4ff68b7e943121e69580 May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-772461889 May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-TestMinimumBasicScenario-772461889-project May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 4db1da4361c444da87400db06bbae3e4 May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-TestMinimumBasicScenario-772461889-project May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:12:30.717516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance ab178055-4b1f-4396-a555-7f196d8a076d is not attached to volume e7daab3e-9a28-404a-9fef-2b3ed8090b70 May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'server_id': 'ab178055-4b1f-4396-a555-7f196d8a076d', 'id': 'e7daab3e-9a28-404a-9fef-2b3ed8090b70'} May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e7daab3e-9a28-404a-9fef-2b3ed8090b70. May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:12:30.718468 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab178055-4b1f-4396-a555-7f196d8a076d is not attached to volume e7daab3e-9a28-404a-9fef-2b3ed8090b70 May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab178055-4b1f-4396-a555-7f196d8a076d is not attached to volume e7daab3e-9a28-404a-9fef-2b3ed8090b70 May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:30.720059 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Returning 404 to user: Instance ab178055-4b1f-4396-a555-7f196d8a076d is not attached to volume e7daab3e-9a28-404a-9fef-2b3ed8090b70 {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:12:30.721381 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f44ed0b1-79e1-43f9-818d-0bdb5b83bff5 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments/e7daab3e-9a28-404a-9fef-2b3ed8090b70" status: 404 len: 154 microversion: 2.1 time: 0.093521 May 10 15:12:30.721381 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 492/964] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:12:30 2022] DELETE /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d/os-volume_attachments/e7daab3e-9a28-404a-9fef-2b3ed8090b70 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:12:30.762452 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:30.763075 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:30.769363 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:30.769963 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:30.770780 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:30.771226 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:30.910710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:30.919805 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-478be0a0-b927-4b2c-8c51-e9a3f2a8d63c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.160724 May 10 15:12:30.920166 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 473/965] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:30 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:31.854915 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:31.855397 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:31.862018 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:31.862489 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:31.863250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:31.863777 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:31.890578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:12:31.936878 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:31.937612 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:31.944183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:31.944699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:31.945487 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:31.946464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:31.966188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3e5b7613-30ab-4e62-865d-aac1f2b958e9 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 204 len: 0 microversion: 2.1 time: 0.115001 May 10 15:12:31.967277 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 493/966] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:12:31 2022] DELETE /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 15:12:31.975366 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:31.976069 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:31.981853 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:31.982304 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:31.983109 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:31.983546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:32.078060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:32.085894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f06e3ee7-840d-4853-bbe4-b6001fd405b3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.152975 May 10 15:12:32.086592 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 474/967] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:31 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:32.114131 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:32.121476 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7c2947cb-a37c-48e7-a4b8-d37a3e57bf3b tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1553 microversion: 2.1 time: 0.150202 May 10 15:12:32.122053 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 494/968] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:31 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:33.103283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:33.103899 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:33.110195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:33.110675 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:33.111439 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:33.111877 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:33.138653 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:33.139275 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:33.145773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:33.146232 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:33.147046 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:33.147490 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:33.241637 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:33.249744 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5a7f5574-4512-4e47-9401-aba84f24e8d1 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.150949 May 10 15:12:33.250333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 475/969] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:33 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:33.273443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:33.281397 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d6033221-4bcd-446e-a294-e6d538e536bc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1553 microversion: 2.1 time: 0.146688 May 10 15:12:33.282003 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 495/970] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:33 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:34.267332 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:34.268061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:34.275441 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:34.275955 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:34.276740 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:34.277178 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:34.298540 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:34.299815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:34.306957 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:34.307496 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:34.308330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:34.308834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:34.442445 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:34.450910 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-918071b0-7bff-4c8b-8f78-aaf2c693424a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1721 microversion: 2.1 time: 0.187315 May 10 15:12:34.451509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 476/971] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:34 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:34.687211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db1da4361c444da87400db06bbae3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7901bd8e4ff68b7e943121e69580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:34.695886 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ade99581-b186-4b55-8f37-2a9db473d4cc tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 200 len: 1511 microversion: 2.1 time: 0.400961 May 10 15:12:34.696467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 496/972] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:34 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:12:34.700891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-a3f791a2-d4c0-4387-84b0-998d42e74cc6 req-71786fde-0021-439c-80f1-fd150fae5e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab178055-4b1f-4396-a555-7f196d8a076d", "name": "network-vif-deleted", "tag": "03b834c1-546f-44db-a170-4f24b1f202fb"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:34.711066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-a3f791a2-d4c0-4387-84b0-998d42e74cc6 req-71786fde-0021-439c-80f1-fd150fae5e83 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:34.712100 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-a3f791a2-d4c0-4387-84b0-998d42e74cc6 req-71786fde-0021-439c-80f1-fd150fae5e83 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:34.725236 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-a3f791a2-d4c0-4387-84b0-998d42e74cc6 req-71786fde-0021-439c-80f1-fd150fae5e83 service nova] Creating event network-vif-deleted:03b834c1-546f-44db-a170-4f24b1f202fb for instance ab178055-4b1f-4396-a555-7f196d8a076d on hv-cinder-83962 May 10 15:12:34.732270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-a3f791a2-d4c0-4387-84b0-998d42e74cc6 req-71786fde-0021-439c-80f1-fd150fae5e83 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034986 May 10 15:12:34.732901 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 477/973] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:35.468174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:35.468788 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:35.475086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:35.475536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:35.476296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:35.476726 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:35.603991 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:35.611796 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8a1a27eb-474f-4b9b-82f6-87bf1ab42acc tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1698 microversion: 2.1 time: 0.147554 May 10 15:12:35.612364 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 497/974] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:35 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1698 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:35.629682 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f31385b5-d716-4af4-8968-e4f0b744a535 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:35.636452 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f31385b5-d716-4af4-8968-e4f0b744a535 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:35.636895 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f31385b5-d716-4af4-8968-e4f0b744a535 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:35.696562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f31385b5-d716-4af4-8968-e4f0b744a535 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Going to try to start instance {{(pid=117168) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 15:12:35.712753 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:35.713369 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] [instance: ab178055-4b1f-4396-a555-7f196d8a076d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:35.719215 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:35.719606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:35.720417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:35.720960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:35.735695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] HTTP exception thrown: Instance ab178055-4b1f-4396-a555-7f196d8a076d could not be found. May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Request method failure captured: May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d HTTP/1.1 May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoBFIIAGMOsGKz2UtQNA_rsrG6Ftm7_Hvo3AMzsIMyb3OvrVzAvWrSojeVlnlFExILr4fYkUC4hPwNIQpJV-j-nGhdHPskQwKB5vTeHx04Nvp-BnN3w6aLc6-6OH73brF6GB05JlwIrj4WJmEBNfAN9708laQvrYN61PRr6bbTBVME8 May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 69cc7901bd8e4ff68b7e943121e69580 May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-TestMinimumBasicScenario-772461889 May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:12:35.737360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/69cc7901bd8e4ff68b7e943121e69580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-TestMinimumBasicScenario-772461889 May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 69cc7901bd8e4ff68b7e943121e69580 May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-772461889 May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-TestMinimumBasicScenario-772461889-project May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 4db1da4361c444da87400db06bbae3e4 May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-TestMinimumBasicScenario-772461889-project May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance ab178055-4b1f-4396-a555-7f196d8a076d could not be found. May 10 15:12:35.738910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'ab178055-4b1f-4396-a555-7f196d8a076d'} May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab178055-4b1f-4396-a555-7f196d8a076d could not be found. May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:12:35.739727 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab178055-4b1f-4396-a555-7f196d8a076d could not be found. May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab178055-4b1f-4396-a555-7f196d8a076d could not be found. May 10 15:12:35.740976 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:12:35.742159 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f31385b5-d716-4af4-8968-e4f0b744a535 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action" status: 202 len: 0 microversion: 2.1 time: 0.111552 May 10 15:12:35.742244 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Returning 404 to user: Instance ab178055-4b1f-4396-a555-7f196d8a076d could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:12:35.742336 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 478/975] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:12:35 2022] POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:12:35.742452 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ca1fb018-bea1-4890-a0b6-c612a8efc095 tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d" status: 404 len: 111 microversion: 2.1 time: 0.029861 May 10 15:12:35.742452 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 498/976] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:35 2022] GET /compute/v2.1/servers/ab178055-4b1f-4396-a555-7f196d8a076d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 15:12:35.747408 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e03c27e4-59fc-448e-93b4-3ad1bb8121ce tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] Calling method '.version_select at 0x7f7de5be31f0>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:35.748211 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:35.749339 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:35.756784 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:35.757246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:35.758197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:35.759427 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:35.765241 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e03c27e4-59fc-448e-93b4-3ad1bb8121ce tempest-TestMinimumBasicScenario-772461889 tempest-TestMinimumBasicScenario-772461889-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1359460779" status: 202 len: 0 microversion: 2.1 time: 0.021279 May 10 15:12:35.765829 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 499/977] 10.222.0.83 () {58 vars in 1271 bytes} [Tue May 10 15:12:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1359460779 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 15:12:35.901449 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:35.909284 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f86085c9-27a3-44b0-aa27-9b697b56a4ad tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1707 microversion: 2.1 time: 0.166210 May 10 15:12:35.910730 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 479/978] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:35 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1707 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:36.927660 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:36.928271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:36.937600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:36.938044 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:36.938843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:36.939282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:37.068287 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:37.076173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e82e4611-618e-4ac2-b334-c4121787db03 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1707 microversion: 2.1 time: 0.152895 May 10 15:12:37.076826 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 500/979] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:36 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:38.093327 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:12:38.093942 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:12:38.100574 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:38.101056 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:38.101823 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:12:38.102843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:12:38.301186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:12:38.309488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f7945789-9dd5-4106-af40-4222751e48df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1711 microversion: 2.1 time: 0.219992 May 10 15:12:38.310420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 480/980] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:12:38 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1711 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:12:53.192752 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8a37ed77-d810-47bf-86ba-36de8accb97a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Action: 'create', calling method: .version_select at 0x7f7de5cfcb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1178037054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj3AYPn5dU898VU/Mgc98n2EeBuHn+zusTRTU36260mZlha9uRLR/7VTa9kekw2APJ412t6vPL6KRMsxLjjo6rlSr+y36ITlPtASCW43gZqF6x8ntF6xScmHzyiQvBE9Q=="}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:53.235734 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-8a37ed77-d810-47bf-86ba-36de8accb97a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for project b89a1e184d314867bd22463ac32df4b5. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:12:53.247951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-8a37ed77-d810-47bf-86ba-36de8accb97a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for user 2d6ea80876104ca0abdf693816c950fa and project b89a1e184d314867bd22463ac32df4b5. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:12:53.318157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8a37ed77-d810-47bf-86ba-36de8accb97a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.460651 May 10 15:12:53.322578 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 501/981] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:12:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:12:57.655357 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-6642cc3e-a402-4584-9302-4c0cc56ae027 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Action: 'create', calling method: .version_select at 0x7f7de5da8dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-115094596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4OwtsWwdanIoBc7Sn0UI5/EQ+u3/yngT/sybUp39K74SQtS5cXNk04PgTYxguqgf+s4t1B0vSVAVdQMa6G/F/xoJ9VEUVUukAq02NBY/ZNlwamD05ohlx9WNwrPfnj3w=="}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:12:57.677658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-6642cc3e-a402-4584-9302-4c0cc56ae027 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Getting quotas for project 68a7b38fce8444d9a3affb21189ee1b8. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:12:57.683329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-6642cc3e-a402-4584-9302-4c0cc56ae027 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Getting quotas for user c7561439a3db4e3988ef5623c27c1aac and project 68a7b38fce8444d9a3affb21189ee1b8. Resources: {'key_pairs'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:12:57.699464 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6642cc3e-a402-4584-9302-4c0cc56ae027 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [01a6734e-bccc-4158-903c-571f49542f4b] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 15:12:58.707010 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [None req-6642cc3e-a402-4584-9302-4c0cc56ae027 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [01a6734e-bccc-4158-903c-571f49542f4b] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 46042. May 10 15:12:58.721623 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-6642cc3e-a402-4584-9302-4c0cc56ae027 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.256171 May 10 15:12:58.722195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 481/982] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:12:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:13:04.594909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:13:04.595484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Tue May 10 15:13:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:13:15.765857 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1041173019", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1178037054", "security_groups": [{"name": "tempest-secgroup-smoke-695398442"}], "block_device_mapping_v2": [{"uuid": "5a172f93-9c27-4f16-aa46-bea0ac579c51", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "32a07968-3f9b-4203-86aa-aef1943e0b30"}]}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:15.968634 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] validate_networks() for [('32a07968-3f9b-4203-86aa-aef1943e0b30', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:13:16.418770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:13:16.419188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:13:16.419655 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:13:16.420058 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:13:16.420465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:13:16.428902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:16.429335 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:16.430124 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:16.430594 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:16.446718 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for project b89a1e184d314867bd22463ac32df4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:13:16.450537 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for user 2d6ea80876104ca0abdf693816c950fa and project b89a1e184d314867bd22463ac32df4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:13:16.504336 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:13:16.506472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a172f93-9c27-4f16-aa46-bea0ac579c51',volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:13:16.627116 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3803b4bd-6230-440d-a57b-8795b971c178 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.865700 May 10 15:13:16.627919 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 502/983] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:13:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:13:16.638255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c8d1ab23-b587-49c8-80ac-066316e16390 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:16.638903 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c8d1ab23-b587-49c8-80ac-066316e16390 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:16.745153 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c8d1ab23-b587-49c8-80ac-066316e16390 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:16.752060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c8d1ab23-b587-49c8-80ac-066316e16390 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1095 microversion: 2.1 time: 0.117569 May 10 15:13:16.752656 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 482/984] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:16 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1095 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:17.769735 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:17.770684 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:17.777760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:17.777969 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:17.778883 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:17.779529 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:17.860175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:17.868849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-fda90a0f-dc54-42b8-9970-447b21a7e0a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1211 microversion: 2.1 time: 0.103647 May 10 15:13:17.869753 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 503/985] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:17 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:18.282158 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:18.282786 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:18.288891 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:18.289363 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:18.290133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:18.290615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:18.387672 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lazy-loading 'services' on Instance uuid 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:13:18.465259 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-487560e2-3f0f-4a0d-9c34-14060d17376b tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-volume_attachments/53af34c9-3c8c-40ac-b840-0b03810f7fff" status: 202 len: 0 microversion: 2.1 time: 0.186969 May 10 15:13:18.465864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 483/986] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:13:18 2022] DELETE /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-volume_attachments/53af34c9-3c8c-40ac-b840-0b03810f7fff => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:13:18.885845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:18.887035 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:18.893585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:18.894273 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:18.895253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:18.895697 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:19.092440 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:19.100650 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-603c7266-4cb3-4bbd-a7b9-e1ae9a9e19b4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.219184 May 10 15:13:19.102514 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 504/987] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:18 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:19.105797 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1195707387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-115094596", "security_groups": [{"name": "tempest-secgroup-smoke-472511282"}], "networks": [{"uuid": "d0f23629-d377-4cbb-a84d-975ce2d47e6f"}], "block_device_mapping_v2": [{"uuid": "3025cde9-ce70-4f96-ac0d-da32a201b678", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:19.226462 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-cc9f9bcb-3f7f-4feb-8e10-5be0d0e6e461 req-9e7a0b91-62c6-4ea4-a2d4-e3e28e2bd5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18923617-4dbf-495e-99ce-f62586762c4a", "tag": "77b62eba-0107-492b-8571-7812f62a6411"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:19.237068 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-cc9f9bcb-3f7f-4feb-8e10-5be0d0e6e461 req-9e7a0b91-62c6-4ea4-a2d4-e3e28e2bd5eb service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:19.237807 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-cc9f9bcb-3f7f-4feb-8e10-5be0d0e6e461 req-9e7a0b91-62c6-4ea4-a2d4-e3e28e2bd5eb service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:19.251096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-cc9f9bcb-3f7f-4feb-8e10-5be0d0e6e461 req-9e7a0b91-62c6-4ea4-a2d4-e3e28e2bd5eb service nova] Creating event network-changed:77b62eba-0107-492b-8571-7812f62a6411 for instance 18923617-4dbf-495e-99ce-f62586762c4a on hv-cinder-83962 May 10 15:13:19.258381 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-cc9f9bcb-3f7f-4feb-8e10-5be0d0e6e461 req-9e7a0b91-62c6-4ea4-a2d4-e3e28e2bd5eb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034439 May 10 15:13:19.259654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 505/988] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:13:19.260048 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] validate_networks() for [('d0f23629-d377-4cbb-a84d-975ce2d47e6f', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:13:19.591784 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-07237c36-3b6e-4a17-b0e9-9cf99fb38a74 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:19.598687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-07237c36-3b6e-4a17-b0e9-9cf99fb38a74 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:19.599140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-07237c36-3b6e-4a17-b0e9-9cf99fb38a74 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:19.627260 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-07237c36-3b6e-4a17-b0e9-9cf99fb38a74 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Going to try to stop instance {{(pid=117167) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 15:13:19.667849 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:13:19.669207 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:13:19.669963 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:13:19.670625 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:13:19.671368 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:13:19.675106 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-07237c36-3b6e-4a17-b0e9-9cf99fb38a74 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action" status: 202 len: 0 microversion: 2.1 time: 0.087291 May 10 15:13:19.678583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 506/989] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:13:19 2022] POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 15:13:19.683581 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:19.684281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:19.685662 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:19.686164 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:19.686690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:19.687751 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:19.698528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:19.699494 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:19.701983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:19.702487 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:19.706448 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Getting quotas for project 68a7b38fce8444d9a3affb21189ee1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:13:19.710289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Getting quotas for user c7561439a3db4e3988ef5623c27c1aac and project 68a7b38fce8444d9a3affb21189ee1b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:13:19.768676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:13:19.770890 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3025cde9-ce70-4f96-ac0d-da32a201b678',volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:13:19.847507 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:19.855961 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d1ea3399-5d08-459c-9020-5cc3df50c878 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.174332 May 10 15:13:19.856694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 507/990] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:19 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:19.901656 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2187f4c9-7848-42c1-a0f7-de21257e0ef9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.800712 May 10 15:13:19.902317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 484/991] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:13:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 15:13:19.912211 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8706f6de-9c6b-474d-a045-b5190c789011 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:19.913382 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8706f6de-9c6b-474d-a045-b5190c789011 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:19.970853 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8706f6de-9c6b-474d-a045-b5190c789011 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:19.978309 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8706f6de-9c6b-474d-a045-b5190c789011 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1088 microversion: 2.1 time: 0.069885 May 10 15:13:19.978931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 508/992] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:19 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:20.117747 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:20.118358 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:20.125774 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:20.126234 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:20.127038 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:20.127475 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:20.266246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:20.274962 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-11c897f3-af5c-471f-a8d3-fefbb658efbd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.161612 May 10 15:13:20.275551 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 485/993] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:20 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:20.873286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:20.874277 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:20.881631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:20.882100 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:20.882946 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:20.883390 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:20.995480 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:20.996096 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:21.002617 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:21.003062 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:21.003829 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:21.004263 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:21.065241 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:21.073512 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c7b7bc1f-a5f1-4328-8032-362b42070e51 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1204 microversion: 2.1 time: 0.081939 May 10 15:13:21.074099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 486/994] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:20 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1204 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:21.104719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:21.112145 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bc541199-d737-451b-80bb-9123e11522fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.242812 May 10 15:13:21.112769 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 509/995] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:20 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:21.292028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:21.292632 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:21.300928 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:21.301379 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:21.302337 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:21.302980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:21.445130 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:21.453181 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f8a3ff9d-a8bd-415b-87cf-b702f1c6b4b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.165894 May 10 15:13:21.453762 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 487/996] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:21 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:22.094168 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:22.094821 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:22.102210 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:22.102696 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:22.103487 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:22.103927 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:22.129487 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:22.130102 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:22.137090 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:22.137535 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:22.138314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:22.138787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:22.270404 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:22.278420 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1e5beea3-7184-4f9b-a3bb-c4dbe12fadd7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.152833 May 10 15:13:22.279177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 488/997] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:22 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:22.434383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:22.443444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-32b495e1-6ef5-4619-9c35-2d73d7c339d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.353101 May 10 15:13:22.444116 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 510/998] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:22 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:22.469066 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:22.469967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:22.475759 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:22.476205 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:22.477039 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:22.477458 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:22.643528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-c5681301-f554-4aa4-a648-e17eb0856c99 req-2f986906-6fc9-48da-9952-a42e07276acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc041f5-6d84-4db8-8b1d-afedcbb7cf48", "tag": "9dd09586-3479-4a0e-9634-5225e7023a63"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:22.654101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-c5681301-f554-4aa4-a648-e17eb0856c99 req-2f986906-6fc9-48da-9952-a42e07276acc service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:22.654678 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-c5681301-f554-4aa4-a648-e17eb0856c99 req-2f986906-6fc9-48da-9952-a42e07276acc service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:22.655585 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:22.668704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-c5681301-f554-4aa4-a648-e17eb0856c99 req-2f986906-6fc9-48da-9952-a42e07276acc service nova] Creating event network-changed:9dd09586-3479-4a0e-9634-5225e7023a63 for instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 on hv-cinder-83962 May 10 15:13:22.673620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b645a24b-dab8-4741-b5e3-083b6257e96e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.208275 May 10 15:13:22.674456 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-c5681301-f554-4aa4-a648-e17eb0856c99 req-2f986906-6fc9-48da-9952-a42e07276acc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102531 May 10 15:13:22.675400 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 511/999] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:13:22.683279 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 489/1000] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:22 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:23.296795 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:23.297493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:23.303461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:23.303909 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:23.305328 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:23.305766 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:23.460970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:23.461590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:23.467863 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:23.468311 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:23.469148 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:23.469587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:23.533426 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:23.542090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f649090b-6cb3-4bb8-b7c8-7ec8f74290de tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.249724 May 10 15:13:23.542912 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 512/1001] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:23 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:23.599852 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:23.608984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-396f236d-a60c-46b0-820c-796fec9b6792 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.151796 May 10 15:13:23.609657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 490/1002] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:23 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:23.690488 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:23.691101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:23.697039 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:23.697490 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:23.698284 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:23.698758 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:23.825392 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:23.832583 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-85808029-bc48-4e34-862f-906164d29948 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.145953 May 10 15:13:23.833155 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 513/1003] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:23 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:24.559579 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:24.560192 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:24.566555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:24.567012 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:24.567767 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:24.568202 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:24.626127 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:24.626843 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:24.633156 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:24.633606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:24.634372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:24.634835 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:24.700314 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:24.707726 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d499ffd8-3b84-4f8d-ab8b-593dbb3c122d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.151989 May 10 15:13:24.708307 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 491/1004] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:24 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:24.763081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:24.770285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-684d61d9-6ca2-4fc9-b851-e0a842ac0ead tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.148267 May 10 15:13:24.770885 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 514/1005] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:24 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:24.849495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:24.850114 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:24.856526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:24.856984 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:24.857753 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:24.858199 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:24.984200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:24.991572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-de39cd22-8039-4d6f-8363-b2cec16cbf21 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.145960 May 10 15:13:24.992725 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 492/1006] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:24 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:25.724574 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:25.725174 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:25.731797 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:25.732188 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:25.732945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:25.733379 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:25.786056 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:25.786687 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:25.793061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:25.793509 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:25.794271 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:25.794733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:25.865782 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:25.873585 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-962b8473-173a-4754-a2d5-00ab7390b541 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.152930 May 10 15:13:25.874425 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 515/1007] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:25 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:25.923017 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:25.930906 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-88a9b9e6-7903-4131-9d8e-cb863775c331 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.148884 May 10 15:13:25.931482 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 493/1008] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:25 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:26.009443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:26.009978 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:26.015811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:26.016258 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:26.017007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:26.017437 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:26.143322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:26.150557 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-63456360-6c83-43d5-9ffb-194427ffa887 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.145570 May 10 15:13:26.151118 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 516/1009] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:26 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:26.891333 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:26.891945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:26.898754 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:26.899212 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:26.900046 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:26.900479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:26.947815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:26.948510 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:26.954933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:26.955379 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:26.956143 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:26.956573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:27.031245 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:27.038658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1827c4ce-24d9-4637-95ba-6efe6408d3df tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.151011 May 10 15:13:27.039233 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 494/1010] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:26 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:27.087586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:27.094802 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1015e77d-4266-421a-b4fd-e08d03da5f2e tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.151285 May 10 15:13:27.095375 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 517/1011] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:26 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:27.167275 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:27.167809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:27.173640 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:27.174085 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:27.174875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:27.175318 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:27.300011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:27.307735 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5697fcbc-a5cf-45e3-bf99-6650f4997f66 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.144512 May 10 15:13:27.308293 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 495/1012] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:27 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:28.055463 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:28.056056 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:28.062309 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:28.062807 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:28.063575 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:28.064016 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:28.111135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:28.111742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:28.118012 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:28.118567 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:28.119343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:28.119781 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:28.194377 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:28.202344 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-991bb724-8774-4d5e-b989-77f7b78fdc93 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.150839 May 10 15:13:28.202968 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 518/1013] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:28 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:28.255098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:28.263257 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-54968c34-18c7-4f39-b700-165b4384b7d3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.155907 May 10 15:13:28.263842 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 496/1014] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:28 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:28.325050 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:28.325607 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:28.331663 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:28.332103 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:28.332858 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:28.333285 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:28.468216 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:28.475573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-22a6b6de-6094-4f31-95cb-b96ddfaa8b34 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.155264 May 10 15:13:28.476140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 519/1015] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:28 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:29.219943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:29.220508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:29.227280 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:29.227731 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:29.228496 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:29.228933 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:29.279798 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:29.280394 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:29.286810 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:29.287253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:29.288011 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:29.288439 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:29.354187 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:29.361542 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c595050f-206d-4bdb-8c3d-c6f6c0c75e15 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1675 microversion: 2.1 time: 0.145544 May 10 15:13:29.362118 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 497/1016] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:29 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:29.418484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:29.425760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-799ff9a8-6f33-4b26-8c11-ae212a6265af tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.149840 May 10 15:13:29.426334 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 520/1017] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:29 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:29.493168 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:29.493785 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:29.499947 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:29.500398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:29.501169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:29.501607 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:29.627921 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:29.635283 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-977a7906-ac61-4374-9cb0-90ddd1f3548b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.146667 May 10 15:13:29.635868 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 498/1018] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:29 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:29.967135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-08f109c0-892e-4b4a-9c90-217338602e9a req-b821483d-4cd2-42dd-897f-971d07438181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18923617-4dbf-495e-99ce-f62586762c4a", "name": "network-vif-plugged", "status": "completed", "tag": "77b62eba-0107-492b-8571-7812f62a6411"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:29.975338 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-08f109c0-892e-4b4a-9c90-217338602e9a req-b821483d-4cd2-42dd-897f-971d07438181 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:29.975762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-08f109c0-892e-4b4a-9c90-217338602e9a req-b821483d-4cd2-42dd-897f-971d07438181 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:29.986614 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-08f109c0-892e-4b4a-9c90-217338602e9a req-b821483d-4cd2-42dd-897f-971d07438181 service nova] Creating event network-vif-plugged:77b62eba-0107-492b-8571-7812f62a6411 for instance 18923617-4dbf-495e-99ce-f62586762c4a on hv-cinder-83962 May 10 15:13:29.991473 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-08f109c0-892e-4b4a-9c90-217338602e9a req-b821483d-4cd2-42dd-897f-971d07438181 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028131 May 10 15:13:29.992107 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 521/1019] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:13:30.379466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:30.380115 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:30.387080 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.387531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.388298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.388737 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.444068 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:30.444898 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:30.451874 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.452407 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.453683 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.454573 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.528418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:30.535717 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-721f9cba-91fa-4a0e-8184-7c69717a3aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1652 microversion: 2.1 time: 0.160110 May 10 15:13:30.536310 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 499/1020] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:30 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1652 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:30.551592 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8fc22985-b905-4795-9f6d-4b5169838d8a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:30.558049 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8fc22985-b905-4795-9f6d-4b5169838d8a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.558529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8fc22985-b905-4795-9f6d-4b5169838d8a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.580423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8fc22985-b905-4795-9f6d-4b5169838d8a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Going to try to start instance {{(pid=117168) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 15:13:30.596183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:30.604040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7dd0a39b-d0ee-40e7-9585-6630b113f277 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.164254 May 10 15:13:30.604823 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 522/1021] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:30 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:30.622952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8fc22985-b905-4795-9f6d-4b5169838d8a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action" status: 202 len: 0 microversion: 2.1 time: 0.074914 May 10 15:13:30.623660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 500/1022] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:13:30 2022] POST /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 15:13:30.632690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:30.633350 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:30.640811 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.641482 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.642923 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.643568 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.652343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:30.653671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:30.659855 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.660389 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.661270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:30.661778 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:30.776916 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:30.784834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7d6b2e13-1bf5-4a84-bb59-acefda230aa7 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1661 microversion: 2.1 time: 0.156036 May 10 15:13:30.785706 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 523/1023] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:30 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:30.797551 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:30.808201 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-13731cb0-aea1-4c44-9e01-95642c5d9698 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1266 microversion: 2.1 time: 0.159579 May 10 15:13:30.808835 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 501/1024] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:30 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:31.623465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:31.624331 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:31.630646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:31.631097 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:31.631849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:31.632288 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:31.805236 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:31.805797 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:31.812106 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:31.812563 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:31.813351 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:31.813795 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:31.837449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:31.847712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-77a8b8ff-c470-4527-a817-f97ff4ffcc55 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.227892 May 10 15:13:31.848483 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 524/1025] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:31 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:31.853346 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:31.854158 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:31.862376 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:31.862937 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:31.863831 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:31.864346 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:31.972488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:31.982603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8210bd7e-0368-4809-8cd3-ec68f81b7b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1661 microversion: 2.1 time: 0.181332 May 10 15:13:31.983195 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 502/1026] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:31 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1661 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:32.041284 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:32.049477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c4febfc2-9abd-4769-abcf-bdaf4b0a3fe2 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1454 microversion: 2.1 time: 0.200218 May 10 15:13:32.051074 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 525/1027] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:31 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:32.065423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:32.066004 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:32.072020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:32.072471 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:32.073245 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:32.073682 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:32.200242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:32.207551 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-237f9053-aced-4195-a4db-c69f9c3c4402 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1454 microversion: 2.1 time: 0.146115 May 10 15:13:32.208123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 503/1028] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:32 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:32.864810 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:32.865455 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:32.872040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:32.872431 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:32.873198 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:32.873628 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:33.000177 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:33.000789 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:33.008087 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:33.008836 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:33.009806 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:33.010421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:33.015503 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:33.025438 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9a8a1a34-683c-4e0c-87cb-a9523374b1df tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.164353 May 10 15:13:33.032505 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 526/1029] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:32 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:33.228560 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:33.236073 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c2dc361b-5b07-4baa-95e4-565936174023 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1665 microversion: 2.1 time: 0.240038 May 10 15:13:33.236966 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 504/1030] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:32 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1665 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:13:33.944862 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-b48e4b4d-6d3d-44b3-a452-96ee520d0f89 req-58ca944b-8989-4165-a2d2-05be608940d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18923617-4dbf-495e-99ce-f62586762c4a", "tag": "77b62eba-0107-492b-8571-7812f62a6411"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:33.954036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-b48e4b4d-6d3d-44b3-a452-96ee520d0f89 req-58ca944b-8989-4165-a2d2-05be608940d8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:33.954512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-b48e4b4d-6d3d-44b3-a452-96ee520d0f89 req-58ca944b-8989-4165-a2d2-05be608940d8 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:33.965867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-b48e4b4d-6d3d-44b3-a452-96ee520d0f89 req-58ca944b-8989-4165-a2d2-05be608940d8 service nova] Creating event network-changed:77b62eba-0107-492b-8571-7812f62a6411 for instance 18923617-4dbf-495e-99ce-f62586762c4a on hv-cinder-83962 May 10 15:13:33.972620 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-b48e4b4d-6d3d-44b3-a452-96ee520d0f89 req-58ca944b-8989-4165-a2d2-05be608940d8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031294 May 10 15:13:33.973206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 527/1031] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:13:34.014315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-53d5762a-430c-4722-a595-110b0fe958fa req-8af7bdd4-28cc-43f1-9188-6bf692c0588c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc041f5-6d84-4db8-8b1d-afedcbb7cf48", "name": "network-vif-plugged", "status": "completed", "tag": "9dd09586-3479-4a0e-9634-5225e7023a63"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:34.032911 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-53d5762a-430c-4722-a595-110b0fe958fa req-8af7bdd4-28cc-43f1-9188-6bf692c0588c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:34.033365 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-53d5762a-430c-4722-a595-110b0fe958fa req-8af7bdd4-28cc-43f1-9188-6bf692c0588c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:34.044125 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:34.044834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:34.055508 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:34.057164 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:34.059205 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:34.060144 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:34.062222 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-53d5762a-430c-4722-a595-110b0fe958fa req-8af7bdd4-28cc-43f1-9188-6bf692c0588c service nova] Creating event network-vif-plugged:9dd09586-3479-4a0e-9634-5225e7023a63 for instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 on hv-cinder-83962 May 10 15:13:34.075083 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-53d5762a-430c-4722-a595-110b0fe958fa req-8af7bdd4-28cc-43f1-9188-6bf692c0588c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064096 May 10 15:13:34.098403 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 505/1032] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:13:34.336270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:34.344305 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-99dd267f-f964-4fb0-82e6-1892daeb9e4a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.304342 May 10 15:13:34.345186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 528/1033] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:34 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:35.361894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:35.362647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:35.368774 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:35.369225 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:35.369988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:35.370444 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:35.502327 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:35.509972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-27101473-49c0-4fce-a084-60f68401371a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1259 microversion: 2.1 time: 0.152728 May 10 15:13:35.510572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 506/1034] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:35 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:36.528258 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:36.529343 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:36.540631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:36.541444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:36.542892 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:36.543685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:36.676167 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:36.683550 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-259af8a7-5b2c-4057-a691-65edbbbfb620 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1442 microversion: 2.1 time: 0.160903 May 10 15:13:36.684120 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 529/1035] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:36 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:36.699723 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:13:36.700343 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:13:36.706633 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:36.707088 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:36.707860 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:36.708302 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:36.834703 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:13:36.842430 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a5cad800-ad18-471e-8a7e-845992eda021 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1442 microversion: 2.1 time: 0.146513 May 10 15:13:36.843007 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 507/1036] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:13:36 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1442 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:13:38.709877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-9e4cd286-674c-4849-bf6d-1a9aa41efc76 req-376231c4-a603-43dd-a6b2-a103fb31f345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc041f5-6d84-4db8-8b1d-afedcbb7cf48", "tag": "9dd09586-3479-4a0e-9634-5225e7023a63"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:13:38.718214 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-9e4cd286-674c-4849-bf6d-1a9aa41efc76 req-376231c4-a603-43dd-a6b2-a103fb31f345 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:13:38.718762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-9e4cd286-674c-4849-bf6d-1a9aa41efc76 req-376231c4-a603-43dd-a6b2-a103fb31f345 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:13:38.729619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-9e4cd286-674c-4849-bf6d-1a9aa41efc76 req-376231c4-a603-43dd-a6b2-a103fb31f345 service nova] Creating event network-changed:9dd09586-3479-4a0e-9634-5225e7023a63 for instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 on hv-cinder-83962 May 10 15:13:38.734544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-9e4cd286-674c-4849-bf6d-1a9aa41efc76 req-376231c4-a603-43dd-a6b2-a103fb31f345 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028405 May 10 15:13:38.735149 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 530/1037] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:14:16.533029 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-28dc7924-6bb5-4e53-bd90-53c7e6b0a5c4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:16.534009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-28dc7924-6bb5-4e53-bd90-53c7e6b0a5c4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:16.540002 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-28dc7924-6bb5-4e53-bd90-53c7e6b0a5c4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:16.540454 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-28dc7924-6bb5-4e53-bd90-53c7e6b0a5c4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:16.541214 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-28dc7924-6bb5-4e53-bd90-53c7e6b0a5c4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:16.541651 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-28dc7924-6bb5-4e53-bd90-53c7e6b0a5c4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:16.569721 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-28dc7924-6bb5-4e53-bd90-53c7e6b0a5c4 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040785 May 10 15:14:16.570274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 508/1038] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:14:16 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:14:16.627615 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:16.628196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:16.634446 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:16.634929 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:16.635691 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:16.636243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:16.661874 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:14:16.733238 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-75eedb71-5f6f-4574-8bdc-e43a72200827 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 204 len: 0 microversion: 2.1 time: 0.109863 May 10 15:14:16.733891 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 531/1039] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:14:16 2022] DELETE /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:14:16.742144 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:16.742802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:16.748981 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:16.749708 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:16.750503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:16.750946 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:16.882371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:16.890215 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ab89ca83-26d9-437f-9bdb-9baebc68b9cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1671 microversion: 2.1 time: 0.152018 May 10 15:14:16.890813 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 509/1040] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:16 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:14:17.908362 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:17.909068 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:17.915127 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:17.915581 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:17.916355 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:17.916809 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:18.047763 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:18.055124 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-34e4f4d9-fad9-490a-93b0-3ffbbcf7d881 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1671 microversion: 2.1 time: 0.150952 May 10 15:14:18.055706 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 532/1041] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:17 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:19.072187 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:19.072804 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:19.079141 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:19.079596 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:19.080371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:19.080806 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:19.211516 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:19.218884 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1d758ea3-3a8e-42e7-a67e-5d476afc672d tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1671 microversion: 2.1 time: 0.150547 May 10 15:14:19.219505 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 510/1042] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:19 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:19.779443 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-987dbb94-0964-49e0-8a6b-bbee84060609 req-c2485c2d-7de2-4d0d-8a16-a18c3b7af1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179c4ae0-b9ad-47e7-9e4f-eceaf008c021", "name": "network-vif-deleted", "tag": "016d01cb-1e3a-4f20-a375-93d38b570a44"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:14:19.788800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-987dbb94-0964-49e0-8a6b-bbee84060609 req-c2485c2d-7de2-4d0d-8a16-a18c3b7af1c9 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:19.802703 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-987dbb94-0964-49e0-8a6b-bbee84060609 req-c2485c2d-7de2-4d0d-8a16-a18c3b7af1c9 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:19.814294 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-987dbb94-0964-49e0-8a6b-bbee84060609 req-c2485c2d-7de2-4d0d-8a16-a18c3b7af1c9 service nova] Creating event network-vif-deleted:016d01cb-1e3a-4f20-a375-93d38b570a44 for instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 on hv-cinder-83962 May 10 15:14:19.820057 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-987dbb94-0964-49e0-8a6b-bbee84060609 req-c2485c2d-7de2-4d0d-8a16-a18c3b7af1c9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044809 May 10 15:14:19.821017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 533/1043] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:14:20.236397 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:20.237027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:20.251339 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:20.252004 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:20.252599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:20.253041 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:20.286129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:20.286869 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:20.287486 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lazy-loading 'fault' on Instance uuid 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:14:20.338135 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:20.345658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0b633238-af42-406e-8fef-e8d8a115b32f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 200 len: 1326 microversion: 2.1 time: 0.113440 May 10 15:14:20.346255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 511/1044] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:20 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:21.365485 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:21.366249 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:21.372453 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:21.372903 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:21.373663 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:21.374101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:21.391368 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] HTTP exception thrown: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Request method failure captured: May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 HTTP/1.1 May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoB_sgmCNr31sE38x9E5IVLKvmVGWvKLtnoTJA1kBl93xklt4tz3gFNPxvBN64MCJNbu9K0xQKktV08yV1m1iHC3YclnPMLooZVpe7OqxcF4bGArRgPCGE68tZR1wapZU0jQ1Ayb5tXDls-qVFrbZ0Y_y3s2mtLBIb50ASX5vSAm_DE May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:14:21.393770 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeTestJSON-1432045127 May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 3b54ed811f2a46fc8c1a0235e06f9509 May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:14:21.395372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '179c4ae0-b9ad-47e7-9e4f-eceaf008c021'} May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:14:21.396243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:14:21.397582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:14:21.398800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Returning 404 to user: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:14:21.398800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-df471602-9c32-4034-bf21-6e89217aac4e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 404 len: 111 microversion: 2.1 time: 0.036085 May 10 15:14:21.398800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 534/1045] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:21 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:14:21.407613 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-dc3f8ac1-d95d-4b08-af22-e8f8ed158fc0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '.version_select at 0x7f7de0c5a310>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:21.425247 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-dc3f8ac1-d95d-4b08-af22-e8f8ed158fc0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-550009401" status: 202 len: 0 microversion: 2.1 time: 0.022668 May 10 15:14:21.425838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 512/1046] 10.222.0.83 () {58 vars in 1217 bytes} [Tue May 10 15:14:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-550009401 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:14:22.019783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2b5d0363-60e2-4fee-96c9-1dbb09ef0f85 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'create', calling method: .version_select at 0x7f7de5c3d5e0>, body: {"keypair": {"name": "tempest-keypair-1525927831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKxHMmRfMxzF+9kcrjHYW3Od5vVcoeUJ73veJSDMWKGEIMVPJEvCPQgy9Uxtz68unJg6J2lyqO1qC+wR6anuLHwF+/51jAVWBhzXXxiAok31JShbHDDOpgv/k0pUBC9dw=="}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:14:22.033255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-2b5d0363-60e2-4fee-96c9-1dbb09ef0f85 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for project 057df79ceee746d7bbd932006cca3ce5. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:14:22.037066 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-2b5d0363-60e2-4fee-96c9-1dbb09ef0f85 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for user 3b54ed811f2a46fc8c1a0235e06f9509 and project 057df79ceee746d7bbd932006cca3ce5. Resources: {'key_pairs'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:14:22.059743 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2b5d0363-60e2-4fee-96c9-1dbb09ef0f85 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043799 May 10 15:14:22.060357 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 535/1047] 10.222.0.83 () {60 vars in 1158 bytes} [Tue May 10 15:14:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:14:23.283818 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-593384385", "imageRef": "1f73234c-3f1f-4788-a16f-d4945fe85283", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8dc7de5-a118-435c-91a1-f67ae4506cd5"}], "security_groups": [{"name": "tempest-securitygroup--1324103385"}], "key_name": "tempest-keypair-1525927831", "user_data": "}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:14:23.383743 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] validate_networks() for [('b8dc7de5-a118-435c-91a1-f67ae4506cd5', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:14:23.736653 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:14:23.737076 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:14:23.737553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:14:23.737992 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:14:23.738418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:14:23.747650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:23.748098 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:23.748904 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:23.749346 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:23.765553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for project 057df79ceee746d7bbd932006cca3ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:14:23.769398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Getting quotas for user 3b54ed811f2a46fc8c1a0235e06f9509 and project 057df79ceee746d7bbd932006cca3ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:14:23.780005 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:14:23.782266 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f73234c-3f1f-4788-a16f-d4945fe85283',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:14:23.829349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cf94e0a6-2a50-4446-8839-cb89a86c764f tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.550546 May 10 15:14:23.829996 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 513/1048] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:14:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 15:14:23.840888 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ef395b02-8cd0-4989-bd39-e8e7516c59e0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:23.841600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ef395b02-8cd0-4989-bd39-e8e7516c59e0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:23.894695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ef395b02-8cd0-4989-bd39-e8e7516c59e0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:23.902006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ef395b02-8cd0-4989-bd39-e8e7516c59e0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1237 microversion: 2.1 time: 0.065312 May 10 15:14:23.902731 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 536/1049] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:23 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:24.919295 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:24.920349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:24.926228 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:24.926719 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:24.927507 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:24.927943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:24.993797 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:25.001493 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-291ad3e4-1b7a-46e8-9fc5-8c9f2f724cda tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1295 microversion: 2.1 time: 0.087413 May 10 15:14:25.002301 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 514/1050] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:24 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:26.019695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:26.020994 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:26.028163 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:26.028631 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:26.029553 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:26.030171 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:26.213513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:26.221444 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e00ff291-c183-4559-bb61-0a7f7d421129 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1363 microversion: 2.1 time: 0.206008 May 10 15:14:26.222109 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 537/1051] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:26 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:26.323246 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-466e429b-dd9d-4b05-9745-c00f79e88146 req-2b2626f1-e8db-41ff-bb79-914320735b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4168535-6df2-4e2d-82b2-e7a4af80125e", "tag": "ffa888f5-c783-4dd8-9e3d-7bcfcab58f71"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:14:26.333280 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-466e429b-dd9d-4b05-9745-c00f79e88146 req-2b2626f1-e8db-41ff-bb79-914320735b63 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:26.333737 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-466e429b-dd9d-4b05-9745-c00f79e88146 req-2b2626f1-e8db-41ff-bb79-914320735b63 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:26.347583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-466e429b-dd9d-4b05-9745-c00f79e88146 req-2b2626f1-e8db-41ff-bb79-914320735b63 service nova] Creating event network-changed:ffa888f5-c783-4dd8-9e3d-7bcfcab58f71 for instance a4168535-6df2-4e2d-82b2-e7a4af80125e on hv-cinder-83962 May 10 15:14:26.353252 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-466e429b-dd9d-4b05-9745-c00f79e88146 req-2b2626f1-e8db-41ff-bb79-914320735b63 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034785 May 10 15:14:26.354368 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 515/1052] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:14:27.238966 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:27.239518 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:27.246333 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:27.246813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:27.247580 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:27.248017 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:27.373741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:27.381366 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-23d47d78-8b8b-448a-8033-63ccd12a66f3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1363 microversion: 2.1 time: 0.146324 May 10 15:14:27.381942 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 538/1053] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:27 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:28.398685 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:28.399387 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:28.405809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:28.406263 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:28.407060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:28.407500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:28.542680 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:28.549882 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d2b9008d-7d44-47cf-a931-6bc452578ac8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1363 microversion: 2.1 time: 0.155524 May 10 15:14:28.550498 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 516/1054] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:28 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:29.566962 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:29.567576 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:29.574418 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:29.574870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:29.575638 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:29.576072 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:29.709705 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:29.717478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-84071482-1497-4c99-8e42-787f2af82d0e tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1363 microversion: 2.1 time: 0.154337 May 10 15:14:29.718041 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 539/1055] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:29 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:30.734764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:30.735396 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:30.741366 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:30.741823 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:30.742620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:30.743067 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:30.865494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:30.872804 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-df061f40-a5fe-4fcc-bf01-f4bd79d22a98 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1363 microversion: 2.1 time: 0.142016 May 10 15:14:30.873375 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 517/1056] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:30 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:31.889673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:31.890270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:31.896643 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:31.897096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:31.897861 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:31.898298 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:32.022542 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:32.029647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c46ef302-ee40-495a-80ca-232f2caa47d0 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1363 microversion: 2.1 time: 0.143817 May 10 15:14:32.030218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 540/1057] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:31 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:32.322031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-d40cf6d8-cbcc-4ff8-89b3-90cc0c30bbf0 req-df50ab82-a748-49bf-a2e6-0eaba7b363f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4168535-6df2-4e2d-82b2-e7a4af80125e", "name": "network-vif-plugged", "status": "completed", "tag": "ffa888f5-c783-4dd8-9e3d-7bcfcab58f71"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:14:32.331153 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-d40cf6d8-cbcc-4ff8-89b3-90cc0c30bbf0 req-df50ab82-a748-49bf-a2e6-0eaba7b363f5 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:32.331599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-d40cf6d8-cbcc-4ff8-89b3-90cc0c30bbf0 req-df50ab82-a748-49bf-a2e6-0eaba7b363f5 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:32.343174 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-d40cf6d8-cbcc-4ff8-89b3-90cc0c30bbf0 req-df50ab82-a748-49bf-a2e6-0eaba7b363f5 service nova] Creating event network-vif-plugged:ffa888f5-c783-4dd8-9e3d-7bcfcab58f71 for instance a4168535-6df2-4e2d-82b2-e7a4af80125e on hv-cinder-83962 May 10 15:14:32.348502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-d40cf6d8-cbcc-4ff8-89b3-90cc0c30bbf0 req-df50ab82-a748-49bf-a2e6-0eaba7b363f5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084584 May 10 15:14:32.349379 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 518/1058] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:14:33.046380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:33.046993 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:33.053240 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:33.053685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:33.054461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:33.054901 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:33.183783 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:33.191028 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d651fb2a-7d27-44a2-828d-49c391ef81e5 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1363 microversion: 2.1 time: 0.148517 May 10 15:14:33.191588 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 541/1059] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:33 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:34.209219 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:34.209970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:34.217200 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:34.217652 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:34.218448 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:34.218894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:34.345806 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:14:34.353315 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-45739f00-9808-464f-a926-a343cf5882cf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1548 microversion: 2.1 time: 0.148385 May 10 15:14:34.353889 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 519/1060] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:14:34 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:14:34.369388 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e26442f8-81d4-448d-b7e3-0f8d02f22eaf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:14:34.370500 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e26442f8-81d4-448d-b7e3-0f8d02f22eaf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:14:34.377006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e26442f8-81d4-448d-b7e3-0f8d02f22eaf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:34.377460 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e26442f8-81d4-448d-b7e3-0f8d02f22eaf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:34.378229 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e26442f8-81d4-448d-b7e3-0f8d02f22eaf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:34.378695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e26442f8-81d4-448d-b7e3-0f8d02f22eaf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:34.452868 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e26442f8-81d4-448d-b7e3-0f8d02f22eaf tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087273 May 10 15:14:34.453467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 542/1061] 10.222.0.83 () {58 vars in 1274 bytes} [Tue May 10 15:14:34 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:14:35.708834 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-ee910f96-b25d-439c-964b-332a24e60314 req-d90a7160-7392-4551-8c49-9b56edbe5714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4168535-6df2-4e2d-82b2-e7a4af80125e", "tag": "ffa888f5-c783-4dd8-9e3d-7bcfcab58f71"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:14:35.717208 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-ee910f96-b25d-439c-964b-332a24e60314 req-d90a7160-7392-4551-8c49-9b56edbe5714 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:14:35.717650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-ee910f96-b25d-439c-964b-332a24e60314 req-d90a7160-7392-4551-8c49-9b56edbe5714 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:14:35.728192 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-ee910f96-b25d-439c-964b-332a24e60314 req-d90a7160-7392-4551-8c49-9b56edbe5714 service nova] Creating event network-changed:ffa888f5-c783-4dd8-9e3d-7bcfcab58f71 for instance a4168535-6df2-4e2d-82b2-e7a4af80125e on hv-cinder-83962 May 10 15:14:35.733155 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-ee910f96-b25d-439c-964b-332a24e60314 req-d90a7160-7392-4551-8c49-9b56edbe5714 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081823 May 10 15:14:35.733745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 520/1062] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:10.490695 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2fbd4f9b-6563-4aa3-83d7-8ab34c0a64bb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:10.491301 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2fbd4f9b-6563-4aa3-83d7-8ab34c0a64bb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:10.497140 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2fbd4f9b-6563-4aa3-83d7-8ab34c0a64bb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:10.497582 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2fbd4f9b-6563-4aa3-83d7-8ab34c0a64bb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:10.498341 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2fbd4f9b-6563-4aa3-83d7-8ab34c0a64bb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:10.498798 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2fbd4f9b-6563-4aa3-83d7-8ab34c0a64bb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:10.521382 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2fbd4f9b-6563-4aa3-83d7-8ab34c0a64bb tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/ips" status: 200 len: 145 microversion: 2.1 time: 0.035127 May 10 15:15:10.521931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 543/1063] 10.222.0.83 () {58 vars in 1247 bytes} [Tue May 10 15:15:10 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:11.826341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-78a4e5d9-a23e-4696-8560-f7f86beb46ec tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb0c8142-82a2-4fd1-943c-e39c9367ef9d"}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:11.827503 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-78a4e5d9-a23e-4696-8560-f7f86beb46ec tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:11.833525 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a4e5d9-a23e-4696-8560-f7f86beb46ec tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:11.833975 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a4e5d9-a23e-4696-8560-f7f86beb46ec tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:11.834757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a4e5d9-a23e-4696-8560-f7f86beb46ec tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:11.835193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-78a4e5d9-a23e-4696-8560-f7f86beb46ec tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:12.062446 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-78a4e5d9-a23e-4696-8560-f7f86beb46ec tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241245 May 10 15:15:12.063211 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 521/1064] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:15:11 2022] POST /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:18.482717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-895d9d89-0565-47e0-ace0-d72bb23b0480 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:18.483712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-895d9d89-0565-47e0-ace0-d72bb23b0480 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:18.489948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-895d9d89-0565-47e0-ace0-d72bb23b0480 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:18.490439 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-895d9d89-0565-47e0-ace0-d72bb23b0480 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:18.491215 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-895d9d89-0565-47e0-ace0-d72bb23b0480 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:18.491659 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-895d9d89-0565-47e0-ace0-d72bb23b0480 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:18.521271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-895d9d89-0565-47e0-ace0-d72bb23b0480 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 May 10 15:15:18.521836 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 544/1065] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:15:18 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:18.532189 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0f0876ee-5c3d-4e54-9400-1c9446565b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:18.532895 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0f0876ee-5c3d-4e54-9400-1c9446565b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:18.539614 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f0876ee-5c3d-4e54-9400-1c9446565b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:18.540061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f0876ee-5c3d-4e54-9400-1c9446565b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:18.540826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f0876ee-5c3d-4e54-9400-1c9446565b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:18.541316 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f0876ee-5c3d-4e54-9400-1c9446565b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:18.568948 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0f0876ee-5c3d-4e54-9400-1c9446565b33 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/fb0c8142-82a2-4fd1-943c-e39c9367ef9d" status: 200 len: 194 microversion: 2.1 time: 0.041097 May 10 15:15:18.569517 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 522/1066] 10.222.0.83 () {58 vars in 1412 bytes} [Tue May 10 15:15:18 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/fb0c8142-82a2-4fd1-943c-e39c9367ef9d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:19.885551 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-9fbf5f12-a5ad-40fa-bd30-a9a904e96917 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff15fd5a-c028-44d7-a474-93905cd8f574"}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:19.886723 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-9fbf5f12-a5ad-40fa-bd30-a9a904e96917 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:19.893030 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fbf5f12-a5ad-40fa-bd30-a9a904e96917 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:19.893481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fbf5f12-a5ad-40fa-bd30-a9a904e96917 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:19.894246 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fbf5f12-a5ad-40fa-bd30-a9a904e96917 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:19.894718 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-9fbf5f12-a5ad-40fa-bd30-a9a904e96917 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:20.124922 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-9fbf5f12-a5ad-40fa-bd30-a9a904e96917 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "POST /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243195 May 10 15:15:20.125862 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 545/1067] 10.222.0.83 () {60 vars in 1322 bytes} [Tue May 10 15:15:19 2022] POST /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:27.595123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-f75488e4-c144-472c-b310-eee4da6a7c42 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:27.596129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-f75488e4-c144-472c-b310-eee4da6a7c42 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:27.602352 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75488e4-c144-472c-b310-eee4da6a7c42 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:27.602909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75488e4-c144-472c-b310-eee4da6a7c42 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:27.603668 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75488e4-c144-472c-b310-eee4da6a7c42 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:27.604101 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-f75488e4-c144-472c-b310-eee4da6a7c42 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:27.635418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-f75488e4-c144-472c-b310-eee4da6a7c42 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044248 May 10 15:15:27.635977 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 523/1068] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:15:27 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:27.777480 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-79a27dee-6155-4dd7-807f-b5d66b1432a8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:27.778715 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-79a27dee-6155-4dd7-807f-b5d66b1432a8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:27.785600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-79a27dee-6155-4dd7-807f-b5d66b1432a8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:27.786191 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-79a27dee-6155-4dd7-807f-b5d66b1432a8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:27.787061 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-79a27dee-6155-4dd7-807f-b5d66b1432a8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:27.787495 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-79a27dee-6155-4dd7-807f-b5d66b1432a8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:27.814803 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-79a27dee-6155-4dd7-807f-b5d66b1432a8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/fb0c8142-82a2-4fd1-943c-e39c9367ef9d" status: 200 len: 194 microversion: 2.1 time: 0.042335 May 10 15:15:27.815366 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 546/1069] 10.222.0.83 () {58 vars in 1412 bytes} [Tue May 10 15:15:27 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/fb0c8142-82a2-4fd1-943c-e39c9367ef9d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:27.825319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:27.825824 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:27.831746 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:27.832197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:27.832966 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:27.833405 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:27.911204 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lazy-loading 'services' on Instance uuid a4168535-6df2-4e2d-82b2-e7a4af80125e {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:15:27.979366 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3a1da3f0-3370-4f88-ac9b-d72f603b77ae tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/fb0c8142-82a2-4fd1-943c-e39c9367ef9d" status: 202 len: 0 microversion: 2.1 time: 0.158301 May 10 15:15:27.980061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 524/1070] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:15:27 2022] DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/fb0c8142-82a2-4fd1-943c-e39c9367ef9d => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:15:29.087923 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6af45020-b299-4090-b489-f5ed0ca81f3c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:29.088469 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6af45020-b299-4090-b489-f5ed0ca81f3c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:29.094634 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af45020-b299-4090-b489-f5ed0ca81f3c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:29.095084 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af45020-b299-4090-b489-f5ed0ca81f3c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:29.095839 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af45020-b299-4090-b489-f5ed0ca81f3c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:29.096270 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af45020-b299-4090-b489-f5ed0ca81f3c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:29.124572 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6af45020-b299-4090-b489-f5ed0ca81f3c tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/ff15fd5a-c028-44d7-a474-93905cd8f574" status: 200 len: 194 microversion: 2.1 time: 0.040595 May 10 15:15:29.125138 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 547/1071] 10.222.0.83 () {58 vars in 1412 bytes} [Tue May 10 15:15:29 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/ff15fd5a-c028-44d7-a474-93905cd8f574 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:29.136028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:29.136649 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:29.142882 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:29.143334 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:29.144108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:29.144575 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:29.221231 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lazy-loading 'services' on Instance uuid a4168535-6df2-4e2d-82b2-e7a4af80125e {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:15:29.288496 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8c66a9ee-8fbd-4c79-8c26-e3d8dd85f51a tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/ff15fd5a-c028-44d7-a474-93905cd8f574" status: 202 len: 0 microversion: 2.1 time: 0.156971 May 10 15:15:29.289014 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 525/1072] 10.222.0.83 () {58 vars in 1415 bytes} [Tue May 10 15:15:29 2022] DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments/ff15fd5a-c028-44d7-a474-93905cd8f574 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:15:30.441493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-17ad8e83-0aac-4b42-80e7-c74f538b4943 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:30.442492 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-17ad8e83-0aac-4b42-80e7-c74f538b4943 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:30.448685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17ad8e83-0aac-4b42-80e7-c74f538b4943 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.449137 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17ad8e83-0aac-4b42-80e7-c74f538b4943 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.449889 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17ad8e83-0aac-4b42-80e7-c74f538b4943 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.450322 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-17ad8e83-0aac-4b42-80e7-c74f538b4943 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.478035 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-17ad8e83-0aac-4b42-80e7-c74f538b4943 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040324 May 10 15:15:30.478606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 548/1073] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:15:30 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:15:30.582161 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a866fa2d-a111-42f0-907d-90fd84d32931 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:30.583294 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a866fa2d-a111-42f0-907d-90fd84d32931 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:30.590988 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a866fa2d-a111-42f0-907d-90fd84d32931 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.591432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a866fa2d-a111-42f0-907d-90fd84d32931 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.592199 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a866fa2d-a111-42f0-907d-90fd84d32931 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.592629 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a866fa2d-a111-42f0-907d-90fd84d32931 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.621060 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a866fa2d-a111-42f0-907d-90fd84d32931 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044703 May 10 15:15:30.621613 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 526/1074] 10.222.0.83 () {58 vars in 1301 bytes} [Tue May 10 15:15:30 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 15:15:30.676730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:30.677223 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:30.683036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.683511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.684266 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.684697 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.709714 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:15:30.786009 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a2556ef4-6296-4598-acff-de0ed6c26fbe tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 204 len: 0 microversion: 2.1 time: 0.112581 May 10 15:15:30.786816 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 549/1075] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:15:30 2022] DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:15:30.794982 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:30.795615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:30.801439 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.801888 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.802756 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:30.803182 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:30.929836 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:30.937274 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-999b21bd-77ec-47e4-b97d-d1e48d0f9431 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1673 microversion: 2.1 time: 0.146211 May 10 15:15:30.937845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 527/1076] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:30 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:31.955746 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:31.956478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:31.962776 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:31.963232 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:31.963996 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:31.964432 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:32.092004 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:32.099284 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d456b11b-5671-4327-a50b-532a783116fa tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1673 microversion: 2.1 time: 0.148348 May 10 15:15:32.099852 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 550/1077] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:31 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:33.117109 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:33.117721 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:33.123976 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:33.124423 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:33.125188 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:33.125911 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:33.260526 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b54ed811f2a46fc8c1a0235e06f9509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057df79ceee746d7bbd932006cca3ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:33.266572 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-09010922-ff8d-4d99-b0dc-60b9ca2749a6 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 200 len: 1673 microversion: 2.1 time: 0.153396 May 10 15:15:33.267156 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 528/1078] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:33 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:33.565928 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-ff817e41-35a0-41a5-8d31-d7853c2c905b req-867196b5-a8b0-450d-b4c4-d5d22905ac6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4168535-6df2-4e2d-82b2-e7a4af80125e", "name": "network-vif-deleted", "tag": "ffa888f5-c783-4dd8-9e3d-7bcfcab58f71"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:33.575702 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-ff817e41-35a0-41a5-8d31-d7853c2c905b req-867196b5-a8b0-450d-b4c4-d5d22905ac6f service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:33.576535 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-ff817e41-35a0-41a5-8d31-d7853c2c905b req-867196b5-a8b0-450d-b4c4-d5d22905ac6f service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:33.588501 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-ff817e41-35a0-41a5-8d31-d7853c2c905b req-867196b5-a8b0-450d-b4c4-d5d22905ac6f service nova] Creating event network-vif-deleted:ffa888f5-c783-4dd8-9e3d-7bcfcab58f71 for instance a4168535-6df2-4e2d-82b2-e7a4af80125e on hv-cinder-83962 May 10 15:15:33.595048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-ff817e41-35a0-41a5-8d31-d7853c2c905b req-867196b5-a8b0-450d-b4c4-d5d22905ac6f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 May 10 15:15:33.596064 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 551/1079] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:34.283809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:34.285456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:34.294103 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:34.294600 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:34.295398 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:34.295983 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:34.312340 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] HTTP exception thrown: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Request method failure captured: May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e HTTP/1.1 May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoB_sgmCNr31sE38x9E5IVLKvmVGWvKLtnoTJA1kBl93xklt4tz3gFNPxvBN64MCJNbu9K0xQKktV08yV1m1iHC3YclnPMLooZVpe7OqxcF4bGArRgPCGE68tZR1wapZU0jQ1Ayb5tXDls-qVFrbZ0Y_y3s2mtLBIb50ASX5vSAm_DE May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:15:34.314027 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 3b54ed811f2a46fc8c1a0235e06f9509 May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:34.315494 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'a4168535-6df2-4e2d-82b2-e7a4af80125e'} May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:15:34.316826 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:34.318193 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:34.320406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Returning 404 to user: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:15:34.320406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-84851394-a5d5-449a-8689-5495134e8cc2 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 404 len: 111 microversion: 2.1 time: 0.035619 May 10 15:15:34.320406 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 529/1080] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:34 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:15:34.325820 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b78a720d-8063-49ec-b924-4ef49e1f37e3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '.version_select at 0x7f7de0713310>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:34.343936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b78a720d-8063-49ec-b924-4ef49e1f37e3 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525927831" status: 202 len: 0 microversion: 2.1 time: 0.022888 May 10 15:15:34.344893 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 552/1081] 10.222.0.83 () {58 vars in 1220 bytes} [Tue May 10 15:15:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525927831 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:15:37.207837 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:37.208340 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:37.215172 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:37.215620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:37.216384 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:37.216822 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:37.229843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] HTTP exception thrown: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Request method failure captured: May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e HTTP/1.1 May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoB_sgmCNr31sE38x9E5IVLKvmVGWvKLtnoTJA1kBl93xklt4tz3gFNPxvBN64MCJNbu9K0xQKktV08yV1m1iHC3YclnPMLooZVpe7OqxcF4bGArRgPCGE68tZR1wapZU0jQ1Ayb5tXDls-qVFrbZ0Y_y3s2mtLBIb50ASX5vSAm_DE May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:15:37.231967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 3b54ed811f2a46fc8c1a0235e06f9509 May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.233590 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': 'a4168535-6df2-4e2d-82b2-e7a4af80125e'} May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:15:37.234615 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.236268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:37.237974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Returning 404 to user: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:15:37.237974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-d37e4fab-3431-4477-8dd9-10fa99a06f78 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 404 len: 111 microversion: 2.1 time: 0.029419 May 10 15:15:37.237974 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 530/1082] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:15:37 2022] DELETE /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:15:37.241547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:37.242289 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: a4168535-6df2-4e2d-82b2-e7a4af80125e] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:37.248954 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:37.249406 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:37.250182 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:37.250949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:37.264159 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] HTTP exception thrown: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Request method failure captured: May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e HTTP/1.1 May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoB_sgmCNr31sE38x9E5IVLKvmVGWvKLtnoTJA1kBl93xklt4tz3gFNPxvBN64MCJNbu9K0xQKktV08yV1m1iHC3YclnPMLooZVpe7OqxcF4bGArRgPCGE68tZR1wapZU0jQ1Ayb5tXDls-qVFrbZ0Y_y3s2mtLBIb50ASX5vSAm_DE May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:15:37.266805 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 3b54ed811f2a46fc8c1a0235e06f9509 May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.268457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'a4168535-6df2-4e2d-82b2-e7a4af80125e'} May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:15:37.269391 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. May 10 15:15:37.270933 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:37.272567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Returning 404 to user: Instance a4168535-6df2-4e2d-82b2-e7a4af80125e could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:15:37.272567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-bebaf93f-dcff-467f-9608-7fa06f70b9f8 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e" status: 404 len: 111 microversion: 2.1 time: 0.030493 May 10 15:15:37.272567 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 553/1083] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:37 2022] GET /compute/v2.1/servers/a4168535-6df2-4e2d-82b2-e7a4af80125e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:15:38.399286 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:38.399803 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:38.406603 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:38.407048 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:38.407972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:38.408410 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:38.421242 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] HTTP exception thrown: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Request method failure captured: May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 HTTP/1.1 May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoB_sgmCNr31sE38x9E5IVLKvmVGWvKLtnoTJA1kBl93xklt4tz3gFNPxvBN64MCJNbu9K0xQKktV08yV1m1iHC3YclnPMLooZVpe7OqxcF4bGArRgPCGE68tZR1wapZU0jQ1Ayb5tXDls-qVFrbZ0Y_y3s2mtLBIb50ASX5vSAm_DE May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:15:38.422990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 3b54ed811f2a46fc8c1a0235e06f9509 May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.424644 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '179c4ae0-b9ad-47e7-9e4f-eceaf008c021'} May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:15:38.425549 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.427081 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:15:38.428608 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Returning 404 to user: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:15:38.428608 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-5b283857-9c91-4c6a-8578-a1a8dc240506 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "DELETE /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 404 len: 111 microversion: 2.1 time: 0.029052 May 10 15:15:38.428608 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 531/1084] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:15:38 2022] DELETE /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:15:38.433777 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:38.434405 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] [instance: 179c4ae0-b9ad-47e7-9e4f-eceaf008c021] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:38.440577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:38.441024 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:38.441782 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:38.442214 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:38.456110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] HTTP exception thrown: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Request method failure captured: May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 HTTP/1.1 May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoB_sgmCNr31sE38x9E5IVLKvmVGWvKLtnoTJA1kBl93xklt4tz3gFNPxvBN64MCJNbu9K0xQKktV08yV1m1iHC3YclnPMLooZVpe7OqxcF4bGArRgPCGE68tZR1wapZU0jQ1Ayb5tXDls-qVFrbZ0Y_y3s2mtLBIb50ASX5vSAm_DE May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:15:38.457633 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/057df79ceee746d7bbd932006cca3ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 057df79ceee746d7bbd932006cca3ce5 May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1432045127 May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 3b54ed811f2a46fc8c1a0235e06f9509 May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-AttachVolumeTestJSON-1432045127-project May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.459311 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '179c4ae0-b9ad-47e7-9e4f-eceaf008c021'} May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:15:38.460253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. May 10 15:15:38.461851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:38.463429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] Returning 404 to user: Instance 179c4ae0-b9ad-47e7-9e4f-eceaf008c021 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:15:38.463429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d56ed9c4-a235-4b89-b96d-961c7af90066 tempest-AttachVolumeTestJSON-1432045127 tempest-AttachVolumeTestJSON-1432045127-project] 10.222.0.83 "GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021" status: 404 len: 111 microversion: 2.1 time: 0.029052 May 10 15:15:38.463429 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 554/1085] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:38 2022] GET /compute/v2.1/servers/179c4ae0-b9ad-47e7-9e4f-eceaf008c021 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:15:40.193245 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:40.194424 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:40.200884 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:40.201563 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:40.202342 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:40.202808 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:40.228308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:15:40.312500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-471b4f04-9964-45cd-b3e4-b5cdf8211e17 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "DELETE /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 204 len: 0 microversion: 2.1 time: 0.122865 May 10 15:15:40.313691 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 532/1086] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:15:40 2022] DELETE /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:15:40.323349 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:40.325472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:40.335109 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:40.335790 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:40.336741 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:40.337526 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:40.518892 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:40.526274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-90e53e2b-6fe0-449c-aec5-ef77c620a15a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1578 microversion: 2.1 time: 0.208151 May 10 15:15:40.527744 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 555/1087] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:40 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:41.546865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:41.547583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:41.566997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:41.567802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:41.568911 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:41.569534 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:41.777670 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:41.786350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9e0c0476-fd6f-4b77-98cf-2b7abb0b2d23 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1578 microversion: 2.1 time: 0.244814 May 10 15:15:41.788052 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 533/1088] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:41 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:42.803196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:42.804359 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:42.814196 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:42.814936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:42.816006 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:42.816683 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:42.924530 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:42.934504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7f04fba8-01cc-4bad-9850-88e2713461b7 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 200 len: 1511 microversion: 2.1 time: 0.134306 May 10 15:15:42.942556 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 556/1089] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:42 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 1511 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:43.001326 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-af5b232f-df81-4c0d-b20b-b80b2a5a35c9 req-a4e9d4f8-7777-4d39-86b1-292fa83a88c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18923617-4dbf-495e-99ce-f62586762c4a", "name": "network-vif-deleted", "tag": "77b62eba-0107-492b-8571-7812f62a6411"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:43.010125 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-af5b232f-df81-4c0d-b20b-b80b2a5a35c9 req-a4e9d4f8-7777-4d39-86b1-292fa83a88c6 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:43.010606 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-af5b232f-df81-4c0d-b20b-b80b2a5a35c9 req-a4e9d4f8-7777-4d39-86b1-292fa83a88c6 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:43.024642 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-af5b232f-df81-4c0d-b20b-b80b2a5a35c9 req-a4e9d4f8-7777-4d39-86b1-292fa83a88c6 service nova] Creating event network-vif-deleted:77b62eba-0107-492b-8571-7812f62a6411 for instance 18923617-4dbf-495e-99ce-f62586762c4a on hv-cinder-83962 May 10 15:15:43.032643 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-af5b232f-df81-4c0d-b20b-b80b2a5a35c9 req-a4e9d4f8-7777-4d39-86b1-292fa83a88c6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035016 May 10 15:15:43.034024 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 534/1090] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:43.586274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:43.586870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:43.592902 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:43.593717 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:43.596628 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:43.597316 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:43.622910 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.objects.instance [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lazy-loading 'flavor' on Instance uuid 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 {{(pid=117167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:15:43.727242 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-7072a71a-8a54-4779-88a6-49d561f0789c tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "POST /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48/action" status: 202 len: 0 microversion: 2.1 time: 0.144842 May 10 15:15:43.728340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 557/1091] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:15:43 2022] POST /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:15:43.737675 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:43.738422 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:43.744666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:43.745562 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:43.747112 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:43.747715 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:43.893995 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:43.901757 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a3aade5e-c438-46a7-982f-44caa433222b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.168375 May 10 15:15:43.902944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 535/1092] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:43 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:43.952560 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:43.953286 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:43.961825 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:43.963122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:43.964271 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:43.965490 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:43.980068 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] HTTP exception thrown: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Request method failure captured: May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a HTTP/1.1 May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoDtsb218WQmzcmPkRG_k-9lx_reV4a1BQ8jhv3lbwcJzxfbcLQIvMqVx1hJ5n6r4LVpCgTddN1tWUSRssw6C-f24C-BfHiVSCyUBgU-aJnTXPgzBMbHN36U2gLubOPDyxOcv0ib_S0hMmQT08jsMKAuzq7NF8AZ9QDZYY2_zpWIDl4 May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:15:43.982293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-TestVolumeBootPattern-1734202237 May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-TestVolumeBootPattern-1734202237-project May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2d6ea80876104ca0abdf693816c950fa May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-TestVolumeBootPattern-1734202237-project May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:15:43.983713 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '18923617-4dbf-495e-99ce-f62586762c4a'} May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:15:43.984543 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:15:43.986383 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:15:43.988563 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Returning 404 to user: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:15:43.988563 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-46e2fdb7-e97c-4b3d-9cc5-06ccb310c72c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 404 len: 111 microversion: 2.1 time: 0.035929 May 10 15:15:43.993256 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 558/1093] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:43 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:15:44.081893 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1535897275", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1178037054", "security_groups": [{"name": "tempest-secgroup-smoke-695398442"}], "block_device_mapping_v2": [{"uuid": "5a172f93-9c27-4f16-aa46-bea0ac579c51", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "32a07968-3f9b-4203-86aa-aef1943e0b30"}]}} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:44.194312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.network.neutron [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] validate_networks() for [('32a07968-3f9b-4203-86aa-aef1943e0b30', None, None, None, None, None)] {{(pid=117168) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:15:44.658621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Flavor limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:15:44.659054 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Image limits 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:15:44.659531 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Flavor pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:15:44.659940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Image pref 0:0:0 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:15:44.660350 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.virt.hardware [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:15:44.668783 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:44.669233 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:44.670036 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:44.670502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:44.686876 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for project b89a1e184d314867bd22463ac32df4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:15:44.690756 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.quota [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for user 2d6ea80876104ca0abdf693816c950fa and project b89a1e184d314867bd22463ac32df4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=117168) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:15:44.745679 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Going to run 1 instances... {{(pid=117168) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:15:44.748344 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a172f93-9c27-4f16-aa46-bea0ac579c51',volume_size=None,volume_type=None)] {{(pid=117168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:15:44.867647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-666309f7-c0d7-4d52-aeb5-b36f9246e8b9 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.789512 May 10 15:15:44.868401 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 536/1094] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:15:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:15:44.878907 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f04ef4f2-c4fc-452e-81fb-51cf6b982af6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:44.879592 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f04ef4f2-c4fc-452e-81fb-51cf6b982af6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:44.920045 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:44.920909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:44.927560 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:44.928112 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:44.928788 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:44.929229 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:44.936548 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f04ef4f2-c4fc-452e-81fb-51cf6b982af6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:44.943104 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f04ef4f2-c4fc-452e-81fb-51cf6b982af6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1095 microversion: 2.1 time: 0.068189 May 10 15:15:44.943870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 559/1095] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:44 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:45.074631 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:45.082376 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-a21af48c-0448-41b8-8d52-688fd8ef8682 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.166625 May 10 15:15:45.093097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 537/1096] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:44 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:45.960135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:45.960900 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:45.969257 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:45.970137 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:45.971418 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:45.972099 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:46.043121 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:46.050644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-75916799-9893-4a01-a678-38d417a214ea tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1211 microversion: 2.1 time: 0.094199 May 10 15:15:46.051220 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 560/1097] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:45 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:46.101255 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:46.101967 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:46.108910 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:46.109364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:46.110418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:46.110865 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:46.257952 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:46.265951 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-46f73db6-585e-462f-a85f-a8d943f2b893 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.168916 May 10 15:15:46.266580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 538/1098] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:46 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:47.068076 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:47.068703 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:47.077122 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:47.078003 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:47.080049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:47.080502 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:47.280589 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-b0fb33e8-c52d-4849-81ef-3b21d8eead19 req-a3012a6a-7541-4ff6-893a-3fdb68e12f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de91b6e8-e626-4cce-bfa4-7721c24eba6d", "tag": "9645f30e-5b91-46c5-9fa3-48ae621660cc"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:47.290545 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-b0fb33e8-c52d-4849-81ef-3b21d8eead19 req-a3012a6a-7541-4ff6-893a-3fdb68e12f74 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:47.291239 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-b0fb33e8-c52d-4849-81ef-3b21d8eead19 req-a3012a6a-7541-4ff6-893a-3fdb68e12f74 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:47.304925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:47.306126 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-b0fb33e8-c52d-4849-81ef-3b21d8eead19 req-a3012a6a-7541-4ff6-893a-3fdb68e12f74 service nova] Creating event network-changed:9645f30e-5b91-46c5-9fa3-48ae621660cc for instance de91b6e8-e626-4cce-bfa4-7721c24eba6d on hv-cinder-83962 May 10 15:15:47.315625 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-663c342c-cf40-4556-96e8-b4a1eed52017 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.251300 May 10 15:15:47.316245 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 561/1099] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:47 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:47.320308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-b0fb33e8-c52d-4849-81ef-3b21d8eead19 req-a3012a6a-7541-4ff6-893a-3fdb68e12f74 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047026 May 10 15:15:47.321006 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 539/1100] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:15:47.325621 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:47.326307 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:47.332685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:47.333312 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:47.334048 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:47.334368 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:47.467183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:47.474434 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-84ecf095-480d-47f7-a7c1-0dbce175097d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.156209 May 10 15:15:47.475007 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 562/1101] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:47 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:48.334020 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:48.334678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:48.340809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:48.341265 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:48.342032 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:48.342501 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:48.474072 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:48.481432 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-9806c483-6ec8-4ec1-b9b6-feb1b9cbe331 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.152174 May 10 15:15:48.482009 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 540/1102] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:48 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:48.490305 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:48.490951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:48.498845 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:48.499622 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:48.501277 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:48.501778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:48.637218 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:48.644478 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ef2491a8-e540-4181-8fe8-c4656519facc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.157996 May 10 15:15:48.645047 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 563/1103] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:48 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:49.497151 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:49.497710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:49.504289 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:49.504741 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:49.505507 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:49.505947 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:49.635145 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:49.643055 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-b793df5b-2120-4db2-82f2-bbc18ddbf8ca tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.149890 May 10 15:15:49.643689 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 541/1104] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:49 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:49.661240 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:49.661850 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:49.668943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:49.669403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:49.670193 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:49.670665 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:49.892790 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:49.900274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d4c9ad2f-6d3b-4743-9c8f-8854923025f3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.242822 May 10 15:15:49.900960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 564/1105] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:49 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:50.659270 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:50.659894 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:50.666223 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:50.666705 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:50.667527 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:50.667964 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:50.797867 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:50.805502 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c20fba59-b92f-4430-8843-9e1cde61abec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.149933 May 10 15:15:50.806875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 542/1106] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:50 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:50.918536 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:50.919066 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:50.925360 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:50.925813 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:50.926619 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:50.927060 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:51.055155 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:51.063073 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c00642d2-1b3e-4b8b-8ad8-f03ea3e1b8ad tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.148934 May 10 15:15:51.063644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 565/1107] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:50 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:15:51.822843 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:51.823588 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:51.829921 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:51.830364 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:51.831166 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:51.831635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:51.962870 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:51.973001 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c3fa3cc8-79cc-43d3-b961-8855ea4c46a0 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.154407 May 10 15:15:51.973583 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 543/1108] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:51 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:52.080554 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:52.081171 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:52.087511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:52.087949 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:52.088719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:52.089157 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:52.213275 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:52.220597 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3c47c2a0-1d79-4271-a37c-5095be4cb560 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.143918 May 10 15:15:52.221164 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 566/1109] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:52 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:52.990456 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:52.991129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:52.997859 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:52.998415 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:52.999292 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:52.999909 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:53.133991 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:53.141965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-18057058-a585-4c87-ae0c-513581b4deda tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.155531 May 10 15:15:53.142568 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 544/1110] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:52 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:53.237419 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:53.238030 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:53.244471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:53.244851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:53.245657 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:53.246095 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:53.386586 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:53.394042 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e7057fb8-2d2c-4f95-a41c-ff6a74943b39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.160421 May 10 15:15:53.394721 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 567/1111] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:53 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:54.158479 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:54.159699 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:54.166218 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:54.166720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:54.167535 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:54.167972 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:54.312226 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:54.320466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c39b0063-e391-47ad-9da4-1ac524f896c4 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.165808 May 10 15:15:54.321301 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 545/1112] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:54 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:54.413169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:54.413790 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:54.421295 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:54.421904 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:54.422750 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:54.423501 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:54.586019 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:54.594262 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-30bbd92a-d3a4-4df1-af1c-f6ef4974dcae tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.185269 May 10 15:15:54.594877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 568/1113] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:54 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:55.337093 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:55.337709 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:55.344504 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:55.344949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:55.345710 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:55.346139 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:55.482460 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:55.490319 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-486a3c76-e2ee-4434-8c33-69da4990801c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.156996 May 10 15:15:55.490938 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 546/1114] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:55 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:15:55.611418 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:55.612258 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:55.618738 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:55.619417 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:55.620319 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:55.620765 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:55.774236 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:55.783842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b2d65fad-9710-4fb2-b22e-b77243c219a1 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.176141 May 10 15:15:55.784851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 569/1115] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:55 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:56.507875 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:56.509258 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:56.515733 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:56.516187 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:56.516970 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:56.517413 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:56.656635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:56.664038 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fa2c6896-9bf2-4f1b-9742-4659feb617c8 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.160518 May 10 15:15:56.664621 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 547/1116] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:56 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:15:56.805241 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:56.806574 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:56.813386 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:56.814277 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:56.815169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:56.815708 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:56.961280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:56.968694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0ddf5cff-0280-4658-b4f9-5cac2e23d091 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.167596 May 10 15:15:56.969272 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 570/1117] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:56 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:57.681120 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:57.681742 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:57.688532 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:57.688989 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:57.689779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:57.690221 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:57.835510 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:57.843448 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-7e5dd536-750d-4057-a4fd-ba7d3f00c979 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.166340 May 10 15:15:57.844035 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 548/1118] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:57 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:57.985282 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:57.985897 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:57.992151 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:57.992602 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:57.993372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:57.993809 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:58.130547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:58.139180 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-84e1540b-102d-4e69-9a1f-f2a113e10e0b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1508 microversion: 2.1 time: 0.157647 May 10 15:15:58.139763 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 571/1119] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:57 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:15:58.156594 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-cda06391-ed32-4b20-8f14-109f7cbffa3b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:15:58.157194 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-cda06391-ed32-4b20-8f14-109f7cbffa3b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:58.163019 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cda06391-ed32-4b20-8f14-109f7cbffa3b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:58.163508 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cda06391-ed32-4b20-8f14-109f7cbffa3b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:58.164276 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cda06391-ed32-4b20-8f14-109f7cbffa3b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:58.164712 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-cda06391-ed32-4b20-8f14-109f7cbffa3b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:58.242011 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-cda06391-ed32-4b20-8f14-109f7cbffa3b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "POST /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48/action" status: 202 len: 0 microversion: 2.1 time: 0.089746 May 10 15:15:58.246340 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 549/1120] 10.222.0.83 () {60 vars in 1277 bytes} [Tue May 10 15:15:58 2022] POST /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:15:58.251973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:58.252589 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:58.259110 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:58.259562 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:58.260330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:58.260960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:58.411351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:58.420760 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0c6007af-6881-41e5-89fb-cbaca3e30158 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1516 microversion: 2.1 time: 0.172878 May 10 15:15:58.421581 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 572/1121] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:58 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:58.861809 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:58.862463 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:58.868863 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:58.869600 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:58.871220 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:58.871666 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:59.028392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:59.036600 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ab7adf56-6f8d-4ffb-96b4-aeb04cb1b260 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.180195 May 10 15:15:59.037506 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 550/1122] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:58 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:15:59.438227 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:15:59.438925 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:15:59.445231 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:59.445682 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:59.446471 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:15:59.446943 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:15:59.748187 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:15:59.756876 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-1eea6120-eef9-41cd-94d5-02f776b6ea7a tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1518 microversion: 2.1 time: 0.322122 May 10 15:15:59.757544 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 573/1123] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:15:59 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1518 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:00.053033 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:00.053673 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:00.061637 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:00.062084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:00.063014 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:00.063329 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:00.203577 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:00.210997 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0f258d90-0d3e-45d3-bdf0-6825ead74963 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.161774 May 10 15:16:00.211580 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 551/1124] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:00 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:00.774945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:00.775511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:00.782519 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:00.782973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:00.783740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:00.784178 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:00.916794 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:00.921351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-8fcfe216-3290-4e82-a362-9d3f493ad63b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.150278 May 10 15:16:00.921924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 574/1125] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:00 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:00.956124 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-eb8e6b7f-3d98-4148-8ac1-7b0831dc8807 req-143a9d5e-2764-4b0f-977d-3acab68b7f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de91b6e8-e626-4cce-bfa4-7721c24eba6d", "name": "network-vif-plugged", "status": "completed", "tag": "9645f30e-5b91-46c5-9fa3-48ae621660cc"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:16:00.964022 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-eb8e6b7f-3d98-4148-8ac1-7b0831dc8807 req-143a9d5e-2764-4b0f-977d-3acab68b7f79 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:00.964522 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-eb8e6b7f-3d98-4148-8ac1-7b0831dc8807 req-143a9d5e-2764-4b0f-977d-3acab68b7f79 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:00.975767 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-eb8e6b7f-3d98-4148-8ac1-7b0831dc8807 req-143a9d5e-2764-4b0f-977d-3acab68b7f79 service nova] Creating event network-vif-plugged:9645f30e-5b91-46c5-9fa3-48ae621660cc for instance de91b6e8-e626-4cce-bfa4-7721c24eba6d on hv-cinder-83962 May 10 15:16:00.981323 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-eb8e6b7f-3d98-4148-8ac1-7b0831dc8807 req-143a9d5e-2764-4b0f-977d-3acab68b7f79 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029109 May 10 15:16:00.981930 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 552/1126] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:16:01.281389 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:01.282004 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:01.287815 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:01.288263 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:01.289025 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:01.289461 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:01.416534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:01.424469 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ea30cc47-00d9-4ccd-8f3f-5746dc9c20f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1266 microversion: 2.1 time: 0.146988 May 10 15:16:01.425603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 575/1127] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:01 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:01.938935 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:01.939642 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:01.945658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:01.946140 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:01.946950 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:01.947390 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:02.137647 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:02.144978 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8056b4b5-bd9a-47f2-a8ab-8a2d219d4f4b tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.210293 May 10 15:16:02.145553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 553/1128] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:01 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:02.441396 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:02.442061 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:02.449321 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:02.449771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:02.450606 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:02.451039 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:02.595780 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:02.603647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-587a3382-5b16-4617-a15c-0e4865a0245f tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1453 microversion: 2.1 time: 0.166434 May 10 15:16:02.604384 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 576/1129] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:02 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:02.620349 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:02.621796 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:02.627918 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:02.628370 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:02.629133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:02.629564 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:02.799160 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:02.807385 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-1e519011-fea8-4880-8620-0a85663f749a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1453 microversion: 2.1 time: 0.190929 May 10 15:16:02.808560 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 554/1130] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:02 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1453 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:03.019620 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-51dd08a0-177a-4d49-8f35-e4c741a22a09 req-37c1409b-43cb-47a8-a4f3-b5f32674697e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc041f5-6d84-4db8-8b1d-afedcbb7cf48", "name": "network-vif-unplugged", "status": "completed", "tag": "9dd09586-3479-4a0e-9634-5225e7023a63"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:16:03.028722 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-51dd08a0-177a-4d49-8f35-e4c741a22a09 req-37c1409b-43cb-47a8-a4f3-b5f32674697e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:03.029397 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-51dd08a0-177a-4d49-8f35-e4c741a22a09 req-37c1409b-43cb-47a8-a4f3-b5f32674697e service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:03.041492 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-51dd08a0-177a-4d49-8f35-e4c741a22a09 req-37c1409b-43cb-47a8-a4f3-b5f32674697e service nova] Creating event network-vif-unplugged:9dd09586-3479-4a0e-9634-5225e7023a63 for instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 on hv-cinder-83962 May 10 15:16:03.047753 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-51dd08a0-177a-4d49-8f35-e4c741a22a09 req-37c1409b-43cb-47a8-a4f3-b5f32674697e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031814 May 10 15:16:03.048431 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 577/1131] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:16:03.162671 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:03.163369 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:03.170886 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:03.171411 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:03.172253 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:03.172763 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:03.337322 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:03.345542 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-32fae1fb-13ef-48b6-8c13-8b63082f9a53 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.187391 May 10 15:16:03.346121 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 555/1132] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:03 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:04.364304 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:04.365129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:04.372951 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:04.373484 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:04.374330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:04.374881 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:04.595473 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:04.603571 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-ad0bc18d-b74e-4ead-b0d0-1e8b90ea71d9 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.244274 May 10 15:16:04.604081 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 578/1133] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:04 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:04.810227 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-91339e3f-5952-4f99-be3e-7083ce3912e1 req-cf742e32-c71c-4880-b679-a80714d0b790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de91b6e8-e626-4cce-bfa4-7721c24eba6d", "tag": "9645f30e-5b91-46c5-9fa3-48ae621660cc"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:16:04.818487 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-91339e3f-5952-4f99-be3e-7083ce3912e1 req-cf742e32-c71c-4880-b679-a80714d0b790 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:04.818943 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-91339e3f-5952-4f99-be3e-7083ce3912e1 req-cf742e32-c71c-4880-b679-a80714d0b790 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:04.830197 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-91339e3f-5952-4f99-be3e-7083ce3912e1 req-cf742e32-c71c-4880-b679-a80714d0b790 service nova] Creating event network-changed:9645f30e-5b91-46c5-9fa3-48ae621660cc for instance de91b6e8-e626-4cce-bfa4-7721c24eba6d on hv-cinder-83962 May 10 15:16:04.835071 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-91339e3f-5952-4f99-be3e-7083ce3912e1 req-cf742e32-c71c-4880-b679-a80714d0b790 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029103 May 10 15:16:04.835729 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 556/1134] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:16:05.622523 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:05.623215 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:05.629973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:05.630481 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:05.631260 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:05.631698 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:05.765046 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:05.772248 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d9b3a519-5a9c-405d-81bf-fe79345707a2 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.155102 May 10 15:16:05.772830 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 579/1135] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:05 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:16:06.790537 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:06.791355 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:06.798320 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:06.798800 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:06.799606 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:06.800067 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:06.935281 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:06.942707 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8ff30445-6b68-4768-b0b1-6fd9dd5d9274 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.157006 May 10 15:16:06.943280 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 557/1136] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:06 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:07.959812 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:07.960430 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:07.967524 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:07.967948 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:07.968859 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:07.969296 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:08.101941 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:08.109779 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-55b8f9dc-be05-46ce-9baa-2d2ab0b87c64 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.153981 May 10 15:16:08.110352 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 580/1137] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:07 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:09.127408 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:09.128030 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:09.134291 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:09.134779 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:09.135544 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:09.135986 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:09.260990 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:09.268276 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-feb67c97-8bc4-4fbb-b7c3-8fef40e95c4d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.145023 May 10 15:16:09.268850 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 558/1138] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:09 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:10.285086 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:10.285622 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:10.291931 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:10.292974 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:10.293851 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:10.294294 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:10.424325 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:10.431607 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f4247eff-9d50-4f06-88d9-e165c4e8b551 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.150571 May 10 15:16:10.432180 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 581/1139] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:10 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:16:11.449472 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:11.450830 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:11.457586 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:11.458347 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:11.459418 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:11.460019 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:11.598062 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:11.605655 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-c3f9b977-742a-4580-8038-a7da127b5320 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1574 microversion: 2.1 time: 0.160554 May 10 15:16:11.606239 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 559/1140] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:11 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:16:12.623200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:16:12.623930 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:16:12.630493 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:12.630947 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:12.631719 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:12.632209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:12.768647 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:16:12.776200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e51e960d-c7d3-4afc-a0cc-c2f968050542 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1561 microversion: 2.1 time: 0.157065 May 10 15:16:12.776960 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 582/1141] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:16:12 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:16:13.280980 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-7e0e43b5-b006-4b81-8dbe-cd1bdca2d369 req-8ef2ee6f-61f0-4b11-af4d-bc4718dcb903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc041f5-6d84-4db8-8b1d-afedcbb7cf48", "name": "network-vif-plugged", "status": "completed", "tag": "9dd09586-3479-4a0e-9634-5225e7023a63"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:16:13.290129 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-7e0e43b5-b006-4b81-8dbe-cd1bdca2d369 req-8ef2ee6f-61f0-4b11-af4d-bc4718dcb903 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:16:13.290620 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-7e0e43b5-b006-4b81-8dbe-cd1bdca2d369 req-8ef2ee6f-61f0-4b11-af4d-bc4718dcb903 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:16:13.302170 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-7e0e43b5-b006-4b81-8dbe-cd1bdca2d369 req-8ef2ee6f-61f0-4b11-af4d-bc4718dcb903 service nova] Creating event network-vif-plugged:9dd09586-3479-4a0e-9634-5225e7023a63 for instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 on hv-cinder-83962 May 10 15:16:13.307179 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-7e0e43b5-b006-4b81-8dbe-cd1bdca2d369 req-8ef2ee6f-61f0-4b11-af4d-bc4718dcb903 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030450 May 10 15:16:13.307850 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 560/1142] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:16:24.604021 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:16:24.604998 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Tue May 10 15:16:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:17:32.224395 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:32.225042 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:32.226495 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-5e37e5d6-90e3-4469-9314-38432eff9d56 req-dedd0665-642f-4503-a587-663c24d92996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc041f5-6d84-4db8-8b1d-afedcbb7cf48", "tag": "9dd09586-3479-4a0e-9634-5225e7023a63"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:17:32.232096 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:32.232626 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:32.233534 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:32.233989 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:32.235371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-5e37e5d6-90e3-4469-9314-38432eff9d56 req-dedd0665-642f-4503-a587-663c24d92996 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:32.235824 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-5e37e5d6-90e3-4469-9314-38432eff9d56 req-dedd0665-642f-4503-a587-663c24d92996 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:32.247844 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-5e37e5d6-90e3-4469-9314-38432eff9d56 req-dedd0665-642f-4503-a587-663c24d92996 service nova] Creating event network-changed:9dd09586-3479-4a0e-9634-5225e7023a63 for instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 on hv-cinder-83962 May 10 15:17:32.253452 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-5e37e5d6-90e3-4469-9314-38432eff9d56 req-dedd0665-642f-4503-a587-663c24d92996 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032250 May 10 15:17:32.254149 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 561/1143] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:17:32.261101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Going to try to terminate instance {{(pid=117167) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:17:32.338983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e9748e99-833d-415e-859a-3c099e14ae39 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 204 len: 0 microversion: 2.1 time: 0.119682 May 10 15:17:32.339924 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 583/1144] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:17:32 2022] DELETE /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:17:32.350083 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:32.350915 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:32.360910 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:32.361461 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:32.362380 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:32.362914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:32.496859 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:32.504676 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-85f0a5d7-4e77-459c-9b31-0ae3b0f68f80 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.159930 May 10 15:17:32.505272 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 562/1145] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:32 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:33.523320 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:33.524031 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:33.530319 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:33.530800 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:33.531564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:33.532000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:33.736208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:33.743498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-a402a92c-9ae1-4f32-bd1c-f1811c58da7f tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1567 microversion: 2.1 time: 0.224486 May 10 15:17:33.744072 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 584/1146] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:33 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:34.439812 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-a22f9f85-1673-409c-bef2-33ad6ba8be4c req-597bac94-8de3-4a8a-9c4b-dedfcd3403b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc041f5-6d84-4db8-8b1d-afedcbb7cf48", "name": "network-vif-deleted", "tag": "9dd09586-3479-4a0e-9634-5225e7023a63"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:17:34.450211 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-a22f9f85-1673-409c-bef2-33ad6ba8be4c req-597bac94-8de3-4a8a-9c4b-dedfcd3403b7 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:34.450745 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-a22f9f85-1673-409c-bef2-33ad6ba8be4c req-597bac94-8de3-4a8a-9c4b-dedfcd3403b7 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:34.465186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-a22f9f85-1673-409c-bef2-33ad6ba8be4c req-597bac94-8de3-4a8a-9c4b-dedfcd3403b7 service nova] Creating event network-vif-deleted:9dd09586-3479-4a0e-9634-5225e7023a63 for instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 on hv-cinder-83962 May 10 15:17:34.471806 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-a22f9f85-1673-409c-bef2-33ad6ba8be4c req-597bac94-8de3-4a8a-9c4b-dedfcd3403b7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038542 May 10 15:17:34.472488 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 563/1147] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:17:34.760838 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:34.761616 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:34.768114 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:34.768565 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:34.769350 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:34.769787 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:34.835564 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:34.843842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-c314ffff-1212-45d1-9c94-29c51f5a16cc tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1219 microversion: 2.1 time: 0.086815 May 10 15:17:34.844428 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 585/1148] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:34 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:35.861604 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:35.862304 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:35.868501 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:35.868940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:35.869701 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:35.870162 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:35.930557 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:35.938043 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-e36b1dd6-2f0b-485e-8668-fdad733fb985 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1219 microversion: 2.1 time: 0.081089 May 10 15:17:35.938654 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 564/1149] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:35 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:36.955208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:36.955827 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:36.962403 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:36.963466 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:36.964234 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:36.964670 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:37.024175 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:37.032402 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-377119ed-e401-4164-9793-200c18971283 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1219 microversion: 2.1 time: 0.080665 May 10 15:17:37.033000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 586/1150] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:36 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:38.051945 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:38.052569 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:38.058985 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:38.059438 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:38.060237 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:38.060675 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:38.093862 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:38.094340 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:38.094796 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.objects.instance [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lazy-loading 'fault' on Instance uuid 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 {{(pid=117168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:17:38.139414 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7561439a3db4e3988ef5623c27c1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a7b38fce8444d9a3affb21189ee1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:38.146031 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-808fdb62-4c25-4af3-a8da-4d53ae110556 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 200 len: 1178 microversion: 2.1 time: 0.097929 May 10 15:17:38.146781 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 565/1151] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:38 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 1178 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:39.164084 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:39.164703 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] [instance: 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:39.171079 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:39.171535 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:39.172300 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:39.172739 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:39.185685 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] HTTP exception thrown: Instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 could not be found. May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Request method failure captured: May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 HTTP/1.1 May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoDyVHG1kZAP12jUkLBMV2F06itDHXp2e2uokvHl5ZZJgV5QW-ES-bkI9Wi0j18Vo0mpc30DWPYIuEbAjAL8FSGs-g9zQUksKtnAL5QNZDK0Q_A4e504y4pcMkWutlApFubgfcOCvGI5kanNamMbRfA1J41RbAR7Z_IqYIMCYhQm4bc May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: 68a7b38fce8444d9a3affb21189ee1b8 May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-TestShelveInstance-1196008193 May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:17:39.187365 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_68a7b38fce8444d9a3affb21189ee1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/68a7b38fce8444d9a3affb21189ee1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/68a7b38fce8444d9a3affb21189ee1b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/68a7b38fce8444d9a3affb21189ee1b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-TestShelveInstance-1196008193 May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: 68a7b38fce8444d9a3affb21189ee1b8 May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-TestShelveInstance-1196008193 May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-TestShelveInstance-1196008193-project May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: c7561439a3db4e3988ef5623c27c1aac May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-TestShelveInstance-1196008193-project May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 could not be found. May 10 15:17:39.189147 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '0bc041f5-6d84-4db8-8b1d-afedcbb7cf48'} May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 could not be found. May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:17:39.190206 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 could not be found. May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 could not be found. May 10 15:17:39.191905 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:17:39.193372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Returning 404 to user: Instance 0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:17:39.193372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-b669717e-2496-4c24-a7bf-8360ba81fa2d tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48" status: 404 len: 111 microversion: 2.1 time: 0.028530 May 10 15:17:39.193372 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 587/1152] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:39 2022] GET /compute/v2.1/servers/0bc041f5-6d84-4db8-8b1d-afedcbb7cf48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:17:39.346153 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-12f04cfc-3db8-4717-a2ab-b1e7d942f0c3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] Calling method '.version_select at 0x7f7de0d325e0>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:39.367792 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-12f04cfc-3db8-4717-a2ab-b1e7d942f0c3 tempest-TestShelveInstance-1196008193 tempest-TestShelveInstance-1196008193-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-115094596" status: 202 len: 0 microversion: 2.1 time: 0.026227 May 10 15:17:39.368421 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 566/1153] 10.222.0.83 () {58 vars in 1250 bytes} [Tue May 10 15:17:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-115094596 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 15:17:42.253161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-364173191", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1178037054", "security_groups": [{"name": "tempest-secgroup-smoke-695398442"}], "block_device_mapping_v2": [{"uuid": "793242e1-692f-4e4a-b5e0-1974cc846611", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "32a07968-3f9b-4203-86aa-aef1943e0b30"}]}} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:17:42.384124 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.network.neutron [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] validate_networks() for [('32a07968-3f9b-4203-86aa-aef1943e0b30', None, None, None, None, None)] {{(pid=117167) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 15:17:42.782019 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Flavor limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 15:17:42.782528 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Image limits 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 15:17:42.783171 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Flavor pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 15:17:42.783577 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Image pref 0:0:0 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 15:17:42.783983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.virt.hardware [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 15:17:42.793161 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:42.793600 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:42.794412 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:42.794842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:42.825040 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for project b89a1e184d314867bd22463ac32df4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 15:17:42.829090 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.quota [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Getting quotas for user 2d6ea80876104ca0abdf693816c950fa and project b89a1e184d314867bd22463ac32df4b5. Resources: {'instances', 'ram', 'cores'} {{(pid=117167) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 15:17:42.888448 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Going to run 1 instances... {{(pid=117167) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 15:17:42.890596 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='793242e1-692f-4e4a-b5e0-1974cc846611',volume_size=None,volume_type=None)] {{(pid=117167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 15:17:43.020050 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-499975f9-acd1-47af-ac78-dd0b4437a8e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770971 May 10 15:17:43.020694 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 588/1154] 10.222.0.83 () {60 vars in 1146 bytes} [Tue May 10 15:17:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 15:17:43.031112 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-08f8fb55-6a45-468a-8526-f92c235a7c67 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:43.031776 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-08f8fb55-6a45-468a-8526-f92c235a7c67 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:43.100864 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-08f8fb55-6a45-468a-8526-f92c235a7c67 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:43.107657 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-08f8fb55-6a45-468a-8526-f92c235a7c67 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1094 microversion: 2.1 time: 0.080423 May 10 15:17:43.108426 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 567/1155] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:43 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:44.124559 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:44.126043 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:44.135130 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:44.135778 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:44.136945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:44.137476 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:44.205533 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:44.214418 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-165669ef-4238-4c77-b101-35830ffee9ab tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1210 microversion: 2.1 time: 0.093745 May 10 15:17:44.215648 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 589/1156] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:44 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:45.235182 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:45.236345 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:45.242925 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:45.247169 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:45.248529 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:45.248973 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:45.404190 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:45.420886 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-63742409-04c9-4bc9-bc68-6ec733a55052 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.193101 May 10 15:17:45.421704 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 568/1157] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:45 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:45.774513 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-8b8b9033-1260-46ae-8d73-3dc01da035b6 req-969fe08c-c412-4e6b-bf4f-0bb677c4c418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065f737d-c69e-4d78-b168-3b1f00674392", "tag": "c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:17:45.812989 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-8b8b9033-1260-46ae-8d73-3dc01da035b6 req-969fe08c-c412-4e6b-bf4f-0bb677c4c418 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:45.813491 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-8b8b9033-1260-46ae-8d73-3dc01da035b6 req-969fe08c-c412-4e6b-bf4f-0bb677c4c418 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:45.847194 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-8b8b9033-1260-46ae-8d73-3dc01da035b6 req-969fe08c-c412-4e6b-bf4f-0bb677c4c418 service nova] Creating event network-changed:c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3 for instance 065f737d-c69e-4d78-b168-3b1f00674392 on hv-cinder-83962 May 10 15:17:45.856854 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-8b8b9033-1260-46ae-8d73-3dc01da035b6 req-969fe08c-c412-4e6b-bf4f-0bb677c4c418 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086015 May 10 15:17:45.857938 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 590/1158] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:17:46.438366 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:46.438965 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:46.445244 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:46.445697 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:46.446530 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:46.447499 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:46.633681 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:46.642186 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ed42db27-f2b3-4ef3-ab91-f621defa6388 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.207633 May 10 15:17:46.643187 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 569/1159] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:46 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:47.660209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:47.660944 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:47.667842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:47.668253 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:47.669038 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:47.669477 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:47.803330 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:47.810618 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-68ed3dfc-d6da-437a-b83b-e3afb2a2b377 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.154808 May 10 15:17:47.811181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 591/1160] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:47 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:17:48.827317 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:48.827940 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:48.834308 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:48.834799 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:48.835570 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:48.836012 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:48.968199 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:48.975555 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-69b20df2-ea71-4c2a-8eda-861f52641fe3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.152130 May 10 15:17:48.976123 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 570/1161] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:48 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:49.992351 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:49.992972 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:49.999280 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:49.999730 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:50.000498 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:50.000958 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:50.129771 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:50.137472 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6809bf66-4b9d-4918-a4bd-50627a7f30d1 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.149018 May 10 15:17:50.138036 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 592/1162] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:49 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:51.152991 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:51.153608 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:51.159949 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:51.160402 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:51.161163 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:51.161602 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:51.292176 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:51.299491 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-fa756d66-7608-4640-9e29-a7d07f675463 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.150367 May 10 15:17:51.300061 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 571/1163] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:51 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:52.316135 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:52.316667 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:52.323034 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:52.323486 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:52.324250 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:52.324687 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:52.458835 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:52.466668 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-410a3671-43d2-45dc-bac6-a55459926ccb tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.154509 May 10 15:17:52.467238 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 593/1164] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:52 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:53.715038 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:53.715650 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:53.721510 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:53.721958 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:53.722749 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:53.723180 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:53.851851 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:53.859718 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-95c91303-49a0-496f-adce-7cc76615e8af tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.379876 May 10 15:17:53.860298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 572/1165] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:53 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:54.876208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:54.876823 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:54.883511 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:54.884002 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:54.884762 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:54.885200 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:55.017329 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:55.026624 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-2c0e7f96-5b64-4c87-8668-f979479b3438 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.154245 May 10 15:17:55.027262 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 594/1166] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:54 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:55.861635 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [req-f713a58c-e450-4adf-82ea-23c9187fb665 req-d9ad5b5e-b47c-4f91-8aa1-f49982ac443c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065f737d-c69e-4d78-b168-3b1f00674392", "name": "network-vif-plugged", "status": "completed", "tag": "c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3"}]} {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:17:55.870729 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-f713a58c-e450-4adf-82ea-23c9187fb665 req-d9ad5b5e-b47c-4f91-8aa1-f49982ac443c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:55.871180 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [req-f713a58c-e450-4adf-82ea-23c9187fb665 req-d9ad5b5e-b47c-4f91-8aa1-f49982ac443c service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:55.884707 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.compute.server_external_events [req-f713a58c-e450-4adf-82ea-23c9187fb665 req-d9ad5b5e-b47c-4f91-8aa1-f49982ac443c service nova] Creating event network-vif-plugged:c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3 for instance 065f737d-c69e-4d78-b168-3b1f00674392 on hv-cinder-83962 May 10 15:17:55.889678 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [req-f713a58c-e450-4adf-82ea-23c9187fb665 req-d9ad5b5e-b47c-4f91-8aa1-f49982ac443c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031717 May 10 15:17:55.890272 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 573/1167] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:17:56.043435 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:56.044087 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:56.050546 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:56.051000 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:56.051773 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:56.052209 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:56.240945 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:56.248772 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-d64990ea-ad64-49bb-b18e-46d60600d31b tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.209270 May 10 15:17:56.249342 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 595/1168] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:56 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:17:57.267268 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:57.267913 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:57.274939 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:57.275388 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:57.276165 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:57.276599 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:57.418842 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:57.426310 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-461f079d-911b-43b6-981a-69e7e8e8448a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1265 microversion: 2.1 time: 0.163840 May 10 15:17:57.427133 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 574/1169] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:57 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:58.444027 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:58.444649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:58.451012 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:58.451467 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:58.452243 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:58.452684 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:58.579690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:58.587145 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f84a2531-1b4e-4631-a8a0-5722c33ed7a6 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1453 microversion: 2.1 time: 0.146930 May 10 15:17:58.588223 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 596/1170] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:58 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:58.603500 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:17:58.604108 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:17:58.610341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:58.610821 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:58.611584 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:17:58.612014 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:17:58.743097 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:17:58.750981 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ee1d57f5-c7bd-4909-9e42-e21722fa630d tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1453 microversion: 2.1 time: 0.151360 May 10 15:17:58.751553 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 575/1171] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:17:58 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:17:59.028341 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:17:59.028536 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Tue May 10 15:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:18:00.589922 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-1e9bdacb-c4de-4e29-8c20-1e3fc70d3e94 req-13c600c3-1497-4c9b-ad79-ea654619189a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065f737d-c69e-4d78-b168-3b1f00674392", "tag": "c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:18:00.598569 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-1e9bdacb-c4de-4e29-8c20-1e3fc70d3e94 req-13c600c3-1497-4c9b-ad79-ea654619189a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:18:00.599098 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-1e9bdacb-c4de-4e29-8c20-1e3fc70d3e94 req-13c600c3-1497-4c9b-ad79-ea654619189a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:18:00.610785 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-1e9bdacb-c4de-4e29-8c20-1e3fc70d3e94 req-13c600c3-1497-4c9b-ad79-ea654619189a service nova] Creating event network-changed:c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3 for instance 065f737d-c69e-4d78-b168-3b1f00674392 on hv-cinder-83962 May 10 15:18:00.615867 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-1e9bdacb-c4de-4e29-8c20-1e3fc70d3e94 req-13c600c3-1497-4c9b-ad79-ea654619189a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029667 May 10 15:18:00.616670 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 597/1172] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:18:13.534563 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:18:13.535274 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Tue May 10 15:18:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:19:32.958764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1ccd6e7-bfb1-44c2-9995-f1c323fd90fb] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 15:19:32.963327 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:32.963823 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:32.965870 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-27a3c219-4284-4bb7-849f-dcc06f613bd7 req-cbb78e42-1cc4-461e-8d1f-9d3ba83cf2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065f737d-c69e-4d78-b168-3b1f00674392", "tag": "c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:19:32.970484 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:32.970936 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:32.971720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:32.972147 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:32.974146 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-27a3c219-4284-4bb7-849f-dcc06f613bd7 req-cbb78e42-1cc4-461e-8d1f-9d3ba83cf2d5 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:32.975133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-27a3c219-4284-4bb7-849f-dcc06f613bd7 req-cbb78e42-1cc4-461e-8d1f-9d3ba83cf2d5 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:32.986293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-27a3c219-4284-4bb7-849f-dcc06f613bd7 req-cbb78e42-1cc4-461e-8d1f-9d3ba83cf2d5 service nova] Creating event network-changed:c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3 for instance 065f737d-c69e-4d78-b168-3b1f00674392 on hv-cinder-83962 May 10 15:19:32.991646 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-27a3c219-4284-4bb7-849f-dcc06f613bd7 req-cbb78e42-1cc4-461e-8d1f-9d3ba83cf2d5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032336 May 10 15:19:32.992540 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 598/1173] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:19:33.002630 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:19:33.087252 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-83358138-da51-41cf-8a13-3452edb3917c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "DELETE /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 204 len: 0 microversion: 2.1 time: 0.129978 May 10 15:19:33.099101 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:33.099834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:33.103296 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 576/1174] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:19:32 2022] DELETE /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:19:33.109388 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:33.109849 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:33.110686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:33.111129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:33.295764 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:19:33.303401 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-f9efde38-63c8-44c6-9940-7a7253bc92da tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1577 microversion: 2.1 time: 0.210441 May 10 15:19:33.304005 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 599/1175] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:33 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:19:34.321043 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:34.321838 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:34.329312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:34.329769 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:34.330587 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:34.331028 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:34.337884 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1ccd6e7-bfb1-44c2-9995-f1c323fd90fb] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 47828. May 10 15:19:34.515942 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:19:34.523914 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-3e3b9d3b-94ce-4d9e-a01b-59b7aa91e81e tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1577 microversion: 2.1 time: 0.207220 May 10 15:19:34.524492 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 577/1176] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:34 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:19:35.279154 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-c98a47d7-32f3-4fed-ba2c-771539157744 req-674f5e16-a67d-47fd-9a70-ea442750655a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065f737d-c69e-4d78-b168-3b1f00674392", "name": "network-vif-deleted", "tag": "c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:19:35.288740 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-c98a47d7-32f3-4fed-ba2c-771539157744 req-674f5e16-a67d-47fd-9a70-ea442750655a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:35.289186 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-c98a47d7-32f3-4fed-ba2c-771539157744 req-674f5e16-a67d-47fd-9a70-ea442750655a service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:35.302411 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-c98a47d7-32f3-4fed-ba2c-771539157744 req-674f5e16-a67d-47fd-9a70-ea442750655a service nova] Creating event network-vif-deleted:c9c3a6bd-c81f-479e-ab7e-e3dc74b975a3 for instance 065f737d-c69e-4d78-b168-3b1f00674392 on hv-cinder-83962 May 10 15:19:35.307155 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-c98a47d7-32f3-4fed-ba2c-771539157744 req-674f5e16-a67d-47fd-9a70-ea442750655a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090426 May 10 15:19:35.307735 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 600/1177] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:19:35.541069 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:35.542018 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:35.548477 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:35.549043 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:35.549912 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:35.550445 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:35.623814 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:19:35.632755 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-342c3987-0428-4334-a82f-cf7ad6aec53c tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 200 len: 1225 microversion: 2.1 time: 0.095048 May 10 15:19:35.633908 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 578/1178] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:35 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:19:36.652449 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:36.653173 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 065f737d-c69e-4d78-b168-3b1f00674392] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:36.659290 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:36.659748 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:36.660515 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:36.660953 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:36.673873 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] HTTP exception thrown: Instance 065f737d-c69e-4d78-b168-3b1f00674392 could not be found. May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Request method failure captured: May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 HTTP/1.1 May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoDtsb218WQmzcmPkRG_k-9lx_reV4a1BQ8jhv3lbwcJzxfbcLQIvMqVx1hJ5n6r4LVpCgTddN1tWUSRssw6C-f24C-BfHiVSCyUBgU-aJnTXPgzBMbHN36U2gLubOPDyxOcv0ib_S0hMmQT08jsMKAuzq7NF8AZ9QDZYY2_zpWIDl4 May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:19:36.675504 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2d6ea80876104ca0abdf693816c950fa May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 065f737d-c69e-4d78-b168-3b1f00674392 could not be found. May 10 15:19:36.677166 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '065f737d-c69e-4d78-b168-3b1f00674392'} May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065f737d-c69e-4d78-b168-3b1f00674392 could not be found. May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:19:36.678165 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065f737d-c69e-4d78-b168-3b1f00674392 could not be found. May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065f737d-c69e-4d78-b168-3b1f00674392 could not be found. May 10 15:19:36.680654 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:36.682181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Returning 404 to user: Instance 065f737d-c69e-4d78-b168-3b1f00674392 could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:19:36.682181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-0e23b916-6a90-4a9d-9050-fcd19976cd77 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392" status: 404 len: 111 microversion: 2.1 time: 0.029720 May 10 15:19:36.682181 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 601/1179] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:36 2022] GET /compute/v2.1/servers/065f737d-c69e-4d78-b168-3b1f00674392 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:19:39.731412 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:39.732084 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:39.738802 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:39.739466 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:39.740245 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:39.740686 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:39.772689 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Going to try to terminate instance {{(pid=117168) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:19:39.791293 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-890b82cd-fa3c-405e-a274-9bd036861f02 req-df379442-88e3-4265-923e-d60076645961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de91b6e8-e626-4cce-bfa4-7721c24eba6d", "tag": "9645f30e-5b91-46c5-9fa3-48ae621660cc"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:19:39.799145 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-890b82cd-fa3c-405e-a274-9bd036861f02 req-df379442-88e3-4265-923e-d60076645961 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:39.799842 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-890b82cd-fa3c-405e-a274-9bd036861f02 req-df379442-88e3-4265-923e-d60076645961 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:39.812887 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-890b82cd-fa3c-405e-a274-9bd036861f02 req-df379442-88e3-4265-923e-d60076645961 service nova] Creating event network-changed:9645f30e-5b91-46c5-9fa3-48ae621660cc for instance de91b6e8-e626-4cce-bfa4-7721c24eba6d on hv-cinder-83962 May 10 15:19:39.818673 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-890b82cd-fa3c-405e-a274-9bd036861f02 req-df379442-88e3-4265-923e-d60076645961 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088549 May 10 15:19:39.820258 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 602/1180] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:19:39.864787 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-0cb9b87a-2d4d-4176-9e28-2013987174f5 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "DELETE /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 204 len: 0 microversion: 2.1 time: 0.137328 May 10 15:19:39.865812 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 579/1181] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:19:39 2022] DELETE /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:19:39.875049 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:39.875877 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:39.883183 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:39.883712 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:39.884623 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:39.885129 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:40.018254 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.policy [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117167) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:19:40.026078 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-6af2d3ae-ca68-4aae-98da-043d908651e3 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1578 microversion: 2.1 time: 0.155650 May 10 15:19:40.026680 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 603/1182] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:39 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 15:19:41.043156 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:41.043850 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:41.050056 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:41.050541 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:41.051298 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:41.051728 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:41.182660 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:19:41.190764 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-ab0bf0c2-690f-4bc1-9d0c-45dfb3990002 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1578 microversion: 2.1 time: 0.151618 May 10 15:19:41.196632 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 580/1183] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:41 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:19:42.071457 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [req-b6c56897-35eb-4898-8189-0186576ae1cf req-0d5cf884-8e28-4e9d-b9c9-7cb371e5c7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de91b6e8-e626-4cce-bfa4-7721c24eba6d", "name": "network-vif-deleted", "tag": "9645f30e-5b91-46c5-9fa3-48ae621660cc"}]} {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:19:42.080207 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-b6c56897-35eb-4898-8189-0186576ae1cf req-0d5cf884-8e28-4e9d-b9c9-7cb371e5c7b5 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:42.080649 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [req-b6c56897-35eb-4898-8189-0186576ae1cf req-0d5cf884-8e28-4e9d-b9c9-7cb371e5c7b5 service nova] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:42.093690 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.compute.server_external_events [req-b6c56897-35eb-4898-8189-0186576ae1cf req-0d5cf884-8e28-4e9d-b9c9-7cb371e5c7b5 service nova] Creating event network-vif-deleted:9645f30e-5b91-46c5-9fa3-48ae621660cc for instance de91b6e8-e626-4cce-bfa4-7721c24eba6d on hv-cinder-83962 May 10 15:19:42.098359 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [req-b6c56897-35eb-4898-8189-0186576ae1cf req-0d5cf884-8e28-4e9d-b9c9-7cb371e5c7b5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030583 May 10 15:19:42.098973 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 604/1184] 10.222.0.83 () {64 vars in 1317 bytes} [Tue May 10 15:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:19:42.210528 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:42.211144 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:42.217392 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:42.217870 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:42.218658 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:42.219099 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:42.286756 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.policy [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6ea80876104ca0abdf693816c950fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89a1e184d314867bd22463ac32df4b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117168) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:19:42.294345 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-2e8ff185-181e-43ea-a6b8-530968e49ecf tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 200 len: 1226 microversion: 2.1 time: 0.088164 May 10 15:19:42.294951 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 581/1185] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:42 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:19:43.312208 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:43.312834 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: de91b6e8-e626-4cce-bfa4-7721c24eba6d] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:43.319044 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:43.319516 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:43.320281 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:43.320716 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:43.333603 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] HTTP exception thrown: Instance de91b6e8-e626-4cce-bfa4-7721c24eba6d could not be found. May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Request method failure captured: May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d HTTP/1.1 May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoDtsb218WQmzcmPkRG_k-9lx_reV4a1BQ8jhv3lbwcJzxfbcLQIvMqVx1hJ5n6r4LVpCgTddN1tWUSRssw6C-f24C-BfHiVSCyUBgU-aJnTXPgzBMbHN36U2gLubOPDyxOcv0ib_S0hMmQT08jsMKAuzq7NF8AZ9QDZYY2_zpWIDl4 May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:19:43.335226 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2d6ea80876104ca0abdf693816c950fa May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance de91b6e8-e626-4cce-bfa4-7721c24eba6d could not be found. May 10 15:19:43.336983 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': 'de91b6e8-e626-4cce-bfa4-7721c24eba6d'} May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de91b6e8-e626-4cce-bfa4-7721c24eba6d could not be found. May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:19:43.337995 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de91b6e8-e626-4cce-bfa4-7721c24eba6d could not be found. May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de91b6e8-e626-4cce-bfa4-7721c24eba6d could not be found. May 10 15:19:43.339686 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.341169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Returning 404 to user: Instance de91b6e8-e626-4cce-bfa4-7721c24eba6d could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:19:43.341169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-3c5a7252-f5a4-4c16-84f8-e356335e006a tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d" status: 404 len: 111 microversion: 2.1 time: 0.029111 May 10 15:19:43.341169 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 605/1186] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:43 2022] GET /compute/v2.1/servers/de91b6e8-e626-4cce-bfa4-7721c24eba6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:19:43.774370 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:43.774908 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.compute.api [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117168) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:43.781156 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:43.781609 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:43.782371 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:43.782847 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG oslo_concurrency.lockutils [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:43.796198 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.wsgi [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] HTTP exception thrown: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Request method failure captured: May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: request: DELETE /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a HTTP/1.1 May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept: application/json May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Accept-Encoding: identity May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Connection: close May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Length: 0 May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Content-Type: application/json May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Host: 10.222.0.83 May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Openstack-System-Scope: None May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: User-Agent: python-urllib3/1.26.9 May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Auth-Token: gAAAAABieoDtsb218WQmzcmPkRG_k-9lx_reV4a1BQ8jhv3lbwcJzxfbcLQIvMqVx1hJ5n6r4LVpCgTddN1tWUSRssw6C-f24C-BfHiVSCyUBgU-aJnTXPgzBMbHN36U2gLubOPDyxOcv0ib_S0hMmQT08jsMKAuzq7NF8AZ9QDZYY2_zpWIDl4 May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Id: None May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Domain-Name: None May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Identity-Status: Confirmed May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Is-Admin-Project: True May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Id: default May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Domain-Name: Default May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Project-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Role: reader,member May 10 15:19:43.797845 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Roles: reader,member May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Id: default May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Domain-Name: Default May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Id: 2d6ea80876104ca0abdf693816c950fa May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: X-User-Name: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: method: > May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: exception: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.799546 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: action_args: {'id': '18923617-4dbf-495e-99ce-f62586762c4a'} May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:19:43.800605 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.802183 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: ERROR nova.api.openstack.wsgi May 10 15:19:43.804437 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Returning 404 to user: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. {{(pid=117168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:19:43.804437 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-8c01e529-4382-4ac9-8282-a7ca89dc52fd tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "DELETE /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 404 len: 111 microversion: 2.1 time: 0.028787 May 10 15:19:43.804437 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 582/1187] 10.222.0.83 () {58 vars in 1238 bytes} [Tue May 10 15:19:43 2022] DELETE /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:19:43.808421 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '>' {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:43.809035 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.compute.api [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] [instance: 18923617-4dbf-495e-99ce-f62586762c4a] Fetching instance by UUID {{(pid=117167) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:19:43.815255 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:43.815704 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:43.816465 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:19:43.816895 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG oslo_concurrency.lockutils [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Lock "cd26bc05-bc65-4702-9c6b-9a4ef8866b2a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:19:43.830380 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.wsgi [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] HTTP exception thrown: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Request method failure captured: May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: request: GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a HTTP/1.1 May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept: application/json May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Accept-Encoding: identity May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Connection: close May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Length: 0 May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Content-Type: application/json May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Host: 10.222.0.83 May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Openstack-System-Scope: None May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: User-Agent: python-urllib3/1.26.9 May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Auth-Token: gAAAAABieoDtsb218WQmzcmPkRG_k-9lx_reV4a1BQ8jhv3lbwcJzxfbcLQIvMqVx1hJ5n6r4LVpCgTddN1tWUSRssw6C-f24C-BfHiVSCyUBgU-aJnTXPgzBMbHN36U2gLubOPDyxOcv0ib_S0hMmQT08jsMKAuzq7NF8AZ9QDZYY2_zpWIDl4 May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Id: None May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Domain-Name: None May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Identity-Status: Confirmed May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Is-Admin-Project: True May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Id: default May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Domain-Name: Default May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Project-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Role: reader,member May 10 15:19:43.831940 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Roles: reader,member May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b89a1e184d314867bd22463ac32df4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Id: b89a1e184d314867bd22463ac32df4b5 May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1734202237 May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Id: default May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Domain-Name: Default May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Id: 2d6ea80876104ca0abdf693816c950fa May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: X-User-Name: tempest-TestVolumeBootPattern-1734202237-project May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: method: > May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: exception: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.833644 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: action_args: {'id': '18923617-4dbf-495e-99ce-f62586762c4a'} May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: {{(pid=117167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:19:43.834512 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. May 10 15:19:43.835801 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: ERROR nova.api.openstack.wsgi May 10 15:19:43.836971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: DEBUG nova.api.openstack.wsgi [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Returning 404 to user: Instance 18923617-4dbf-495e-99ce-f62586762c4a could not be found. {{(pid=117167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:19:43.836971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO nova.api.openstack.requestlog [None req-e892b819-42e0-4999-bcf4-3be7c34d2937 tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a" status: 404 len: 111 microversion: 2.1 time: 0.029440 May 10 15:19:43.836971 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: [pid: 117167|app: 0|req: 606/1188] 10.222.0.83 () {58 vars in 1235 bytes} [Tue May 10 15:19:43 2022] GET /compute/v2.1/servers/18923617-4dbf-495e-99ce-f62586762c4a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:19:45.117961 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: DEBUG nova.api.openstack.wsgi [None req-54162bd5-e51b-46a3-b037-19286723b6ec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] Calling method '.version_select at 0x7f7de5d0d430>' {{(pid=117168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:19:45.135870 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO nova.api.openstack.requestlog [None req-54162bd5-e51b-46a3-b037-19286723b6ec tempest-TestVolumeBootPattern-1734202237 tempest-TestVolumeBootPattern-1734202237-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1178037054" status: 202 len: 0 microversion: 2.1 time: 0.021782 May 10 15:19:45.136452 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: [pid: 117168|app: 0|req: 583/1189] 10.222.0.83 () {58 vars in 1262 bytes} [Tue May 10 15:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1178037054 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 15:21:19.038683 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:21:19.039284 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Tue May 10 15:21:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:21:33.544379 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:21:33.544970 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Tue May 10 15:21:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:23:04.625340 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:23:04.626133 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Tue May 10 15:23:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:24:39.046720 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:24:39.047361 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Tue May 10 15:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:24:53.551936 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:24:53.552547 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Tue May 10 15:24:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:24:57.649944 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:24:57.650547 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Tue May 10 15:24:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:25:00.007415 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:25:00.007974 dv-cinder-839628-2-iscsi devstack@n-api.service[117167]: Tue May 10 15:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 15:25:00.183744 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 15:25:00.184312 dv-cinder-839628-2-iscsi devstack@n-api.service[117168]: Tue May 10 15:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!